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ABSTRACT 


This  report  describes  the  application  and  evaluation  of 
four  primary  statistical  models  in  the  forecasting  of  hori- 
zontal marine  visibility  over  selected  physically  homogeneous 
areas  of  the  North  Atlantic  Ocean.   The  main  focus  of  this 
study  is  to  propose  an  optimal  model  output  statistics  (MOS) 
approach  to  operationally  forecast  visibility  at  the  00-hour 
model  initialization  time  and  the  24-hour  and  48-hour  model 
forecast  projections.   The  technique  utilized  involves  the 
manipulation  of  observed  visibility  and  Navy  Operational 
Global  Atmospheric  Prediction  System  (NOGAPS)  model  output 
parameters.   The  models  employ  the  statistical  methodologies 
of  maximum  conditional  probability,  natural  regression  and 
minimum  probable  error  linear  regression  threshold  tech- 
niques.  Additionally,  an  evaluation  of  the  1983  predictive 
arrays/equations  using  1984  NOGAPS  data  fields  and  a  maximum- 
likelihood-of-detection  threshold  model  were  accomplished. 
Results  show  that  two  statistical  approaches,  namely  a  maxi- 
mum conditional  probability  strategy  utilizing  linear 
regression  equation  predictors  and  the  minimum  probable 
error  threshold  models,  produce  the  best  results  achieved  in 
this  study. 
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I .   INTRODUCTION  AND  BACKGROUND 

One  of  the  most  significant  advances  in  objective  weather 
prediction,  since  the  introduction  of  numerical  weather 
prediction  in  the  19  50's  and  satellite  remote  sensing  capa- 
bilities in  the  1960 's,  has  been  the  development  of  Model 
Output  Statistics  (MOS)  weather  forecasting  method  by  Glahn 
and  Lowry  (1972).   In  general,  this  technique  is  the  deter- 
mination of  a  statistical  relationship  between  an  operational 
weather  element  (predictand) ,  which  may  or  may  not  be  fore- 
cast by  numerical  methods,  and  numerical  model  output  varia- 
bles (predictors),  usually  via  linear  regression  methods. 
The  resulting  predictand/predictor  regression  equations 
provide  the  basis  for  generating  a  statistical  weather  pre- 
diction.  The  National  Weather  Service  (NWS)  has  included  MOS 
as  an  integral  part  of  their  weather  forecasting  operations 
since  the  early  1970 's.   Currently,  the  NWS  maintains  MOS 
prediction  equations  for  approximately  15  weather  elements 
(e.g.  ceiling,  visibility,  obstructions  to  vision,  precipi- 
tation, etc.)  at  forecast  times  ranging  from  6  to  48  hours. 
These  forecasts  are  routinely  provided  to  approximately  295 
civilian  and  190  military  locations  throughout  the  continental 
United  States  (CONUS)  and  Alaska  [Glahn,  1983]. 

Based  on  the  impressive  results  achieved  with  the  NWS 
MOS  program,  the  Department  of  Defense  (DOD) ,  through  the  Air 
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Weather  Service  (AWS),  implemented  and  operated  a  quasi- 
global  version  of  the  NWS  MOS  system  at  the  Air  Force  Global 
Weather  Center  (AFGWC) ,  Offutt  AFB ,  Nebraska  [Best  and  Pryor, 
1983] .   The  first  operational  forecasts  obtained  from  the  AWS 
MOS  system  were  produced  by  AFGWC  in  December  19  80  and  the 
system  ran  operationally  for  a  period  of  approximately  18 
months.   Regions  for  which  operational  MOS  forecasts  were 
produced  included  Europe,  Asis  (including  Korea  and  Japan), 
the  South  China  Sea  (including  the  Philippines  and  Taiwan) , 
the  near  and  middle  east  and  northern  Africa.   The  AWS  MOS 
program  was  terminated  with  the  recent  decision  to  replace  the 
current  hemispheric  primitive  equation  (PE)  model  with  a 
spectral  global  dynamic  model  [Klein,  1981]. 

Throughout  its  tenure  as  an  operational  forecast  scheme, 
the  AWS  MOS  system  provided  the  U.S.  Air  Force  with  a  rela- 
tively low  cost,  flexible  and  responsive  prediction  network. 
Further  development  of  the  AWS  MOS  system  has  been  postponed 
until  sufficient  spectral  model  output  is  archived. 

The  U.S.  Navy,  by  virtue  of  its  unique  marine  forecast- 
ing responsibilities,  has  a  keen  interest  in  applying  MOS 
forecasting  schemes  to  global  oceanic  regions.   Through  the 
research  and  development  efforts  of  the  Naval  Environmental 
Prediction  Research  Facility  (NEPRF)  in  Monterey,  California, 
the  Navy  has  sponsored  a  limited  amount  of  research  into  naval 
applications  of  MOS.   In  particular,  statistical  studies  have 
been  done  into  forecasting  Levante  winds  in  Spain  [Godfrey  and 
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Lowe,  1979],  ceiling  and  visibility  prediction  in  the  southern 
California  (SOCAL)  naval  operating  area  [Lewit,  1980],  marine 
fog  and  visibility  predictability  in  the  North  Pacific  Ocean 
[Renard  et  al.,  1983  and  Renard  and  Thompson,  1984].   Presently, 
a  program  is  in  operation  which  provides  MOS  forecasts  for 
selected  U.S.  Navy  and  Marine  Corps  CONUS  locations.   These 
services,  which  are  made  available  from  NWS,  are  based  on  the 
National  Meteorological  Center  (NMC)  limited  fine  mesh  model 
predictions.   This  MOS  program  was  initiated  on  10  November 
1982  and  provides  forecasts  for  twelve  weather  parameters 
which  include  visibility,  obstructions  to  visibility  and 
cloud  amount  [Naval  Environmental  Prediction  Research 
Facility,  1982] . 

The  results  of  these  limited  studies  along  with  the 
encouraging  performances  of  both  the  NWS  and  AWS  MOS  programs 
and  the  implementation  of  the  Navy  Operational  Global  Atmos- 
pheric Prediction  System  (NOGAPS)  dynamical  primitive  equation 
(PE)  model  at  the  Fleet  Numerical  Oceanography  Center  (FNOC) , 
in  Monterey,  California  prompted  the  decision  in  September 
1982  for  the  Navy  to  pursue  its  own  MOS  program. 

Fig.  1  is  an  overview  of  the  currently  proposed  milestones 
for  the  Navy  MOS  program.   The  first  operational  weather 
parameter  being  investigated  in  this  proposed  ten-year  Navy 
effort  is  horizontal  visibility  at  sea,  with  the  initial  goal 
of  this  project  being  the  investigation  and  development  of 
statistical  predictive  schemes  for  forecasting  horizontal 
visibility  over  the  North  Atlantic  Ocean. 
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The  impact  of  fog  and  other  impediments  to  visibility  on 
naval  operations  is  well  documented  throughout  maritime 
history.   Records  show  countless  catastrophes  and  accidents 
which  were  directly  attributable  to  poor  visibility  at  sea. 
For  example,  on  29  May  1914,  the  Canadian  liner  Empress  of 
Ireland  collided  with  the  Norwegian  vessel  Storstad  in  dense 
fog  on  the  Saint  Lawrence  River  resulting  in  1,024  fatalities 
and  similarly,  the  legendary  "North  Sea  haze"  was  a  critical 
element  in  the  World  War  I  tactics  employed  at  Jutland  in 
1916.   Also,  one  of  the  most  spectacular  maritime  disasters 
in  the  U.S.  Navy's  history  took  place  on  9  September  1923 
when  seven  Pacific  fleet  destroyers  struck  the  rocks  and  ran 
aground  in  dense  fog  off  of  Point  Arguello,  California. 

Research  into  predicting  marine  visibility  via  traditional 
linear  regression  methodologies  has  taken  place  at  the  Naval 
Postgraduate  School  (NPS)  since  the  early  1960 's.   Generally, 
early  visibility  forecasting  experiments  identified  potential 
physical  air/ocean  mechanisms  [Schramn,  1966]  and  emphasized 
the  inherent  likelihood  of  human  error  in  at-sea  visibility 
observations  [Nelson,  1972].   Later  experimentation  by 
Aldinger  (1979),  Yavorsky  (1980)  and  Selsor  (1980)  concen- 
trated on  various  modifications  to  multiple  linear  regression 
schemes  and  the  analysis  of  prediction  skill  measurements. 

This  study  presents  a  direct  follow-on  to  the  research 
presented  by  Karl  (1984),  in  which  statistical  methodologies 
presented  by  Preisendorf er  (1983a, b,c)  and  multiple  linear 
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regression  techniques  presented  by  Lowe  (1984a)  were  compared 
and  contrasted.   In  Karl's  preliminary  study,  Preisendorf er ' s 
three  strategies,  two  based  on  maximum  conditional  proba- 
bility and  one  based  on  natural  regression,  as  well  as 
Lowe's  linear  regression  threshold  models  were  tested  and 
applied  to  sets  of  FNOC  model  output  parameters  (MOPs)  from 
both  the  North  Pacific  and  North  Atlantic  Ocean  areas.   The 
North  Atlantic  Ocean  study  was  separated  into  effective 
physically  homogeneous  areas  [Lowe,  1984b].   Karl's  study 
specifically  dealt  with  an  evaluation  of  the  MOS  scheme 
applied  to  oceanic  regions  for  the  TAU-00  model  output 
during  the  period  15  May  to  07  July  19  83. 

This  study  concerns  itself  with  a  continued  evaluation 
and  further  refinement  of  statistical  methods  proposed  by 
Preisendorf er  as  well  as  the  linear  regression  threshold 
models  presented  by  Lowe.   With  reference  to  Karl's  study, 
other  North  Atlantic  Ocean  areas  and  model  forecast  projections 
(e.g.  TAU-24  and  TAU-48)  are  addressed. 
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I I .   OBJECTIVES  AND  APPROACH 

The  primary  objectives  of  this  study  are  to  continue  the 
previous  NPS  horizontal  marine  visibility  prediction  re- 
search initiated  by  Karl  (1984)  and  to  continue  the  search 
for  an  optimal  Model  Output  Statistics  (MOS)  prediction 
scheme  to  operationally  forecast  coastal  and  open  ocean 
visibility  over  the  North  Atlantic  Ocean.   The  approach 
employed  in  meeting  the  stated  objectives  is  listed  below: 

A.  Apply  and  evaluate  the  Preisendorf er  maximum  proba- 
bility and  natural  regression  strategies  (1983a, b,c)  to  addi- 
tional North  Atlantic  Ocean  homogeneous  areas  [Lowe,  1983b] 
using  May  through  July  198  3,  NOGAPS  predictand/predictor 
data . 

B.  Expand  the  Model  Output  Predictor  (MOP)  data  sets  to 
include  the  NOGAPS  model  TAU-00,  and  the  TAU-24  and  TAU-48 
prognostic  times  defined  in  Chapter  III. 

C.  Investigate  specific  two-stage,  equal  variance  and 
quadratic  multiple  linear  regression  threshold  models  pro- 
posed by  Lowe  (1984a)  for  the  oceanic  areas  and  model  output 
periods  addressed  in  A.  and  B.  above. 

D.  Compare  and  contrast  the  individual  results  of  the 
Preisendorf er  statistical  methodologies  to  those  of  the  Lowe 
approach. 

E.  Conduct  a  limited  series  of  experiments  in  which  a 
1984  data  set,  15  May  to  23  June,  is  utilized  as  an 
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independence  evaluation  of  the  predictive  models  constructed 
with  19  8  3  NOGAPS  data. 

F.   Based  on  A.  to  E .  above,  present  an  interim  recommenda- 
tion for  an  optimal  statistical  approach  to  forecast  North 
Atlantic  Ocean  horizontal  visibility  as  a  function  of  pre- 
diction time  and  homogeneous  area. 
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III.   DATA 

A.   VISIBILITY  OBSERVATIONS  AND  SYNOPTIC  CODES 

Horizontal  visibility  observations  taken  from  seagoing 
platforms  are  reported  as  values  of  ten  standardized  World 
Meteorological  Organization  (WMO)  synoptic  weather  codes. 
These  codes  range  in  value  from  90,  which  corresponds  to 
visibility  less  than  50  meters,  to  99,  which  corresponds  to 
visibility  equal  to  or  greater  than  50  kilometers.   Human 
observational  error  and  inexactness  in  measuring  visibility 
at  sea  necessitates  a  generalization  of  visibility  classifi- 
cation for  prediction  purposes,  as  follows: 

Visibility  Category  Synoptic  Code  Visibility  Range 

I  90-94  <  2  km 

II  95-96  ^  2  km  to  <  10  km 

III  97-99  ^  10  km 

The  above  scheme  coincides  with  the  classification  scheme 
proposed  by  Karl  (1984)  and  is  based  upon  the  below  listed 
U.S.  Navy  operational  criteria. 

1.  10  km  (5  n  mi)--U.S.  Navy  aircraft  carrier  at-sea 
flight  recovery  operations  change  from  visual  (VFR)  to 
controlled  (IFR)  approach  guidelines  [Department  of  the 
Navy,  1979] . 

2.  2  km  (1  n  mi) — the  sounding  of  reduced  visibility 
signals  for  all  vessels  operating  in  international  waters. 
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The  term  "reduced  visibility"  is  not  specifically  defined  in 
the  International  Regulations  for  Preventing  Collisions  at 
Sea,  1972.   The  distance  of  1  n  mi  is  generally  considered 
to  be  the  governing  operational  distance. 

B.   NORTH  ATLANTIC  OCEAN  DATA 

1.  Area 

The  North  Atlantic  Ocean,  from  0°-80°  N  latitude, 
was  divided  into  homogeneous  oceanic  areas  by  Lowe  (19  84b) 
using  a  statistical  cluster  analysis  technique.   The  specific 
homogeneous  areas  evaluated  in  this  study  are  identified  as 
areas  2,  3W  and  4  on  Fig.  2.   These  areas  were  selected  be- 
cause they  individually  represent  a  range  of  different  rela- 
tive frequencies  of  poor  visibility  observations.   Area  3W , 
which  was  used  by  Karl  (1984)  for  his  preliminary  experimen- 
tation, represents  an  area  of  relatively  frequent  occurrence 
of  poor  visibility,  while  area  4  represents  an  area  of  rela- 
tively sparse  occurrence  of  poor  visibility  and  area  2 
represents  an  intermediate  case. 

2.  Time  Period 

Data  from  mid-May  1983  to  mid-July  1983  were  combined 
to  form  a  more  extensive  data  set,  hereafter  referred  to  as 
FATJUNE  19  83.   FATJUNE  19  83  was  selected  as  the  initial  data 
set  for  statistical  experimentation  because  of  the  high  fre- 
quency of  occurrence  of  poor  visibility  observations  for 
many  areas  of  the  North  Atlantic  Ocean  during  this  period. 
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1200  GMT  synoptic  ship  report  data  were  used  exclusively  in 
this  study.   This  time  corresponds  to  general  daylight  condi- 
tions over  the  North  Atlantic  Ocean  during  FAT JUNE .   In 
addition  to  FATJUNE  1983,  a  limited  May  15  to  June  23  1984 
data  set,  possessing  the  same  geographical  coverage  and  day- 
light characteristics  of  FATJUNE  1983,  was  utilized  in  an 
independent  test  of  the  predictive  arrays  and  equations 
generated  in  this  study. 

For  the  purpose  of  this  study,  TAU-00  generally 
represents  six-hour  model  forecast  fields  valid  at  1200  GMT. 
Three  specific  fields,  namely  temperature,  geopotential 
height  and  wind,  are  model  initialization  fields  valid  at 
1200  GMT.   TAU-24  and  TAU-48  are  defined  as  24-hour  and 
48-hour  model  forecast  fields,  valid  at  1200  GMT.   TAU-00, 
TAU-24  and  TAU-48  model  output  parameters  (predictors)  are 
employed  in  the  00,  24  and  48  hour  forecast  schemes,  respect- 
fully.  Summaries  of  the  visibility  frequencies  for  each 
visibility  category,  as  a  function  of  homogeneous  area 
and  prediction  time,  for  FATJUNE  1983  and  the  15  May  to  23 
June  1984  data  set,  are  contained  in  Tables  I  through  III 
and  Table  VI  respectively. 

3 .   Synoptic  Weather  Reports 

All  synoptic  visibility  observations  (predictand  data) 
for  this  study  were  provided  by  the  Naval  Oceanography  Com- 
mand Detachment  (NOCD) ,  Asheville,  North  Carolina  which  is 
co-located  with  the  National  Climatic  Data  Center  (NCDC) . 
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The  observations  which  contained  systematic  observer  error 
or  were  obviously  erroneous,  as  determined  from  the  data 
quality  indicators  provided  with  the  data,  were  deleted 
from  the  working  data  sets. 
4 .   Predictor  Parameters 

Fifty  TAU-00,  fifty- four  TAU-24  and  fifty- four  TAU-48 
model  output  predictors  (MOP's)  were  provided  by  the  Fleet 
Numerical  Oceanography  Center  (FNOC) ,  Monterey,  California. 
These  parameters  are  generated  by  their  current  operational 
atmospheric  prediction  model,  the  Navy  Operational  Global 
Atmospheric  Prediction  System  (NOGAPS) .   All  MOP's  were 
interpolated  from  model  grid  coordinates  to  synoptic  ship 
report  position  using  a  linear  interpolation  scheme.   In 
addition  to  the  initial  group  of  model  output  parameters, 
ten  derived  parameters  representing  calculated  quantities, 
such  as  parameter  gradients  and  products ,  were  included  as 
potential  predictors.   Of  the  entire  group  of  potential 
predictor  parameters,  only  forty  TAU-00  and  forty-seven 
TAU-24  and  TAU-48  MOP's  were  actually  used  to  develop  the 
various  Preisendorfer  (1983a, b,c)  and  linear  regression 
threshold  models  [Lowe,  19  8  3a] .   The  remainder  of  the  NOGAPS 
model  output  parameters  were  dropped  from  consideration  because 
1)  the  MOP  lacked  a  physical  linkage  to  the  visibility  pre- 
dictand  and/or  2)  a  lack  of  significant  digits  (lost  during 
the  transfer  of  FNOC  data  to  the  main  computer  center's 
mass  storage  system)  rendered  the  particular  MOP  useless. 
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A  list  of  all  available  TAU-00 ,  TAU-24  and  TAU-48  MOP ' s  are 
included  in  Appendix  B. 

For  each  homogeneous  area  and  model  forecast  projec- 
tion, a  set  of  three  linear  regression  equations,  in  addition 
to  the  aforementioned  MOP ' s ,  were  included  as  potential 
mop's  for  a  separate  evaluation  of  the  Preisendorf er  methodology 
(the  PR+BMD  model).   These  three  predictor  equations  were 
obtained  from  two  standardized  linear  regression  software 
packages,  namely  P2R--stepwise  regression  and  P9R — all 
possible  subsets  regression,  as  addressed  in  the  BMDP  Sta- 
tistical Software  [University  of  California,  1983].   The 
P2R  was  initially  employed  in  the  evaluation  of  areas  2  and 
4,  TAU-00  data,  while  the  P9R  program  was  employed  in  the 
remainder  of  the  cases  studied.   The  change  to  the  P9R 
program  was  initiated  as  a  safeguard  against  any  potential 
predictor  selection  bias  incorporated  in  the  P2R  software. 
Specific  details  concerning  these  statistical  software 
packages  are  addressed  in  Appendix  A. 

C.   DEPENDENT/INDEPENDENT  DATA  SETS 

Due  to  the  limited  amount  of  data  available  to  this 
study  for  each  of  the  North  Atlantic  Ocean  homogeneous  areas, 
it  was  necessary  to  withhold  a  significant  amount  of  the 
observations  from  the  developmental  model  to  use  as  an 
independent  data  set.   That  amount  was  set  as  one»-third  for 
the  experiments  reported  here.   This  was  accomplished  by  the 
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use  of  a  counter  and  transfer  statement  in  the  computer 
programs  which  prevented  every  third  observation  from  enter- 
ing the  developmental  computations.   To  ensure  that  the 
dependent  and  independent  data  were  representative  of  the 
same  population,  a  9  5%  confidence  interval  for  proportions 
[Miller  and  Freund ,  1977]  was  established  from  the  entire 
data  set,  for  each  visibility  category,  and  the  dependent 
and  independent  data  sets  were  constrained  to  have  visibility 
frequencies  within  these  established  confidence  intervals. 
Table  IV  summarizes  the  dependent  and  independent  data  for 
the  North  Atlantic  Ocean  data  set. 
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IV.   PROCEDURES 

A.   TERMS  AND  SYMBOLS 

The  terms  and  statistical  symbols  defined  below  will 
be  used  throughout  the  remainder  of  this  report.   The 
formal  mathematical  definitions  are  described  in  Karl  (1984). 

1.  Maximum  probability  strategy--choosing  forecast 
visibility  category  based  upon  the  highest  conditional 
probability  of  visibility  within  a  predictor  interval. 

a.  MAXPROB  I — designation  of  the  maximum  probability 
strategy  in  which  ties  of  the  highest  conditional  probabili- 
ties in  a  predictor  interval  are  resolved  by  the  generation 
of  a  random  number. 

b.  MAXPROB  II--designation  of  the  maximum  probability 
strategy  in  which  ties  of  the  highest  conditional  probabili- 
ties in  a  predictor  interval  are  resolved  by  assigning  the 
lowest  visibility  category,  of  those  tied,  as  the  forecast 
category . 

2.  Natural  regression  strategy--choosing  forecast  visi- 
bility categories  based  upon  the  statistical  average  of  the 
conditional  probabilities  of  visibility  within  a  predictor 
interval . 

3.  AO — the  probability  of  a  zero-class  visibility  cate- 
gory forecast  error  (e.g.,  if  visiblity  category  I  is 
forecast  and  observed) . 
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4.  Al — the  probability  of  a  one-class  visibility  category 
forecast  error  (e.g.,  if  visibility  category  I  is  forecast 
and  category  II  is  observed) . 

5.  CE — class  error  parameter  defined  as  A0+2A1,  used  as 
the  primary  aid  in  identifying  the  first  predictor. 

6.  PP — the  potential  predictability  of  visibility  by  any 
given  predictor. 

7.  Functional  dependence.   This  is  a  measure  of  the 
stochastic  dependence  of  one  predictor  upon  another.   Func- 
tional dependence  is  the  probability  that  one  of  the  predic- 
tors will  change  when  the  other  does.   High  functional 
dependence  values  between  one  already  selected  predictor  and 
another  potential  predictor,  indicates  that  little  addi- 
tional information  beyond  the  selected  predictor  is  possible. 
Conversely,  a  low  functional  dependence  value  between  the 
same  two  predictors,  indicates  that  each  predictor  possesses 
a  high  degree  of  linearly  uncorrelated  information  concerning 
the  predictand.   Functional  dependence  range  is  0.0  to  1.0 
(1.0  =  highest  functional  dependence).   The  specific  deriva- 
tion and  mathematical  description  of  the  concept  of  "func- 
tional dependence"  is  discussed  in  greater  depth  by 
Preisendorfer  (1983c). 

8.  Root-sum-squared  functional  dependence.   The  functional 
dependence  of  a  predictor  on  all  predictors  already  included 
in  the  developmental  model.   It  is  equal  to  the  square-root 
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of  the  sum  of  the  squares  of  the  individual  functional 
dependence  values. 

9.  TSl — threat  score  for  visibility  category  I,  as 
computed  from  a  contingency  table  (see  Appendix  C) . 

10.  ATSl--adjusted  threat  score  for  visibility  category 
I  which  removes  the  influence  of  the  data  set  category 
frequency  (see  Appendix  C) . 

11.  AAO--ad justed  AO .   A  contingency  table  statistic 
which  removes  the  influence  of  the  most  frequent  visibility 
category  in  a  set  of  data  (similar  to  a  normalized  value) 
(see  Appendix  C) . 

B.   COMPUTER  PROGRAMS 

Four  computer  programs  were  developed  to  test  the  pro- 
posed Preisendorf er  (1983a, b,c)  methodology.   The  programs 
are  on  file  in  the  Department  of  Meteorology,  Naval  Post- 
graduate School,  Monterey,  California,  93943. 

1.  A  program  to  compute  AO ,  Al ,  CE  and  PP  for  all  predic- 
tors, all  strategies  (MAXPROB  I,  MAXPROB  II  and  natural 
regression)  for  a  particular  number  of  equally  populous 
predictor  intervals.   Statistics  for  the  three  strategies 
are  based  upon  the  same  predictor (s)  rather  than  the  best 
predictor (s)  for  each  strategy. 

2.  A  program  to  compute  functional  dependence  values  for 
all  predictors,  on  a  given  predictor,  for  a  given  number  of 
equally  populous  predictor  intervals  and  to  compute  the 
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associated  96%  critical  confidence  interval  value,  referred 
to  as  functional  dependence (9  6)  in  this  study,  by  Monte  Carlo 
means . 

3.  A  program  to  construct  contingency  tables  and  to 
compute  skill  and  threat  scores,  for  both  the  dependent  and 
Independent  data  sets. 

4.  A  program  to  generate  100  random  data  sets,  from  the 
marginal  probabilities  of  the  predictor (s)  in  the  develop- 
mental model,  and  to  compute  upper  and  lower  5%  critical 
confidence  interval  values  for  AO  and  Al  to  be  used  for 
testing  the  significance  of  the  results  from  each  of  the 
Preisendorf er  mcdels  against  chance.   These  confidence 
interval  values  are  calculated  via  Monte  Carlo  means. 

C .   MODELS 

1.   Preisendorf er  PR  Model 

This  model  represents  the  first  of  two  different 
applications  of  the  basic  Preisendorf er  methodology 
[Preisendorf er ,  1983a, b,c].   Karl  (1984),  in  his  preliminary 
research,  provides  a  rigorous  interpretation  and  results 
associated  with  this  statistical  forecasting  methodology. 
Karl's  study  provides  the  necessary  background  for  the  con- 
tinued investigation  and  evaluation  of  this  model  and  readers 
interested  in  specific  details  are  advised  to  consult  this 
document. 

The  PR  model  utilizes  the  working  set  of  NOGAPS 
model  output  parameters  (MOP's)  and  derived  parameters 
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(Appendix  B)  as  potential  predictors  in  constructing  a 
developmental  model,  based  upon  the  dependent  data  set, 
which  provides  the  structure  by  which  the  independent  data 
set  is  tested  and  evaluated.   In  general,  these  potential 
predictors  have  their  range  of  values  partitioned  into 
discretized  equally  populous  predictor  intervals  ("cells") 
and  conditional  probabilities  of  the  predictand  are  calcu- 
lated according  to  the  three  modified  visibility  categories 

(VISCAT)  I,  II  and  III.   Three  separate  strategies  of  deter- 
mining the  specific  VISCAT  which  is  to  be  identified  with 
each  predictor  value,  are  proposed.   These  strategies,  two 
based  upon  maximum  probability  and  the  third  based  on  a 
natural  regression  approach,  are  addressed  as  MAXPROB  I, 
MAXPROB  II  and  natural  regression  in  the  remaining  portions 
of  this  study. 

Initial  evaluation  of  this  model  involves  varying  the 
equally  populous  predictor  intervals  from  sizes  of  four 
through  ten,  and  selecting  an  optimal  first  predictor  which 
provides  one  of  the  following  requirements  in  the  designated 
order : 

a.  the  lowest  CE  value  of  all  the  potential  predictors 

b.  the  highest  PP  value  of  all  the  potential  predictors 

Once  a  first  predictor  is  identified  for  each  of  the 
four  through  ten  equally  populous  predictor  intervals, 
corresponding  VISCAT  I,  II  and  III  threat  and  AO  skill 
scores  (Appendix  E)  are  calculated  for  both  the  dependent 
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and  independent  data  sets.   The  practice  of  selecting  an 
optimal  equally  populous  predictor  interval  from  the  eligible 
grouping  sizes  of  four  through  ten,  was  proposed  by  Karl 
(1984)  as  a  practical  procedure  which  would  permit  the 
realization  of  peak  skill  scores  as  well  as  maintain  asso- 
ciated computer  storage  requirements  at  a  manageable  level. 
An  unfortunate  consequence  of  this  range  of  potential  group- 
ing sizes  is  that  certain  statistical  calculations  associated 
with  equally  populous  predictor  intervals  of  eight,  nine 
and  ten  are  terminated  before  completion  due  to  a  two  mega- 
byte storage  ceiling  at  the  NPS  W.R.  Church  Computer  Center. 
When  considering  potential  predictor  intervals,  the  size  of 
the  interval  is  of  obvious  importance,  with  lower  values 
being  the  most  desirable.   The  criterion  for  determining  the 
optimal  equally  populous  predictor  interval  is  to  select  the 
smallest  interval  value  which  maximizes  the  dependent  data 
set  adjusted  AO  and  independent  adjusted  VISCAT  I  threat 
score.   For  this  study,  this  interval  value  was  fixed  for 
all  ensuing  aspects  of  the  model  evaluation.   In  practice, 
the  selection  of  equally  populous  predictor  intervals  was 
based  upon  the  initial  adjusted  AO  (dependent  data)  and  the 
adjusted  VISCAT  I  threat  score  (independent  data)  for  the 
MAXPROB  II  strategy.   The  MAXPROB  II  scores  were  routinely 
found  to  be  the  highest  for  each  case  evaluated,  at  this 
early  stage  in  the  evaluation  process,  and  therefore  used 
as  the  basis  for  grouping  selection.   As  the  equally  populous 
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grouping  interval  remains  constant  throughout  the  Preisen- 
dorfer  models,  the  MAXPROB  I  and  natural  regression  strate- 
gies practically  play  no  role  in  the  predictor  selection 
process. 

Once  the  first  predictor  and  its  associated  equally 
populous  predictor  interval  have  been  identified,  a  func- 
tional dependence  test  of  the  first  predictor  against  those 
remaining  potential  predictors  is  run.   The  second,  third 
and  all  subsequent  predictors  are  selected  only  if  both  of 
the  following  criteria  are  met: 

a.  subsequent  predictors  must  increase  AO  over  the 
AO  value  attained  at  the  preceding  level,  and 

b.  the  selected  predictor  must  have  the  lowest 
functional  dependence  and  root-sum- square 
functional  dependence  of  all  the  remaining 
potential  predictors. 

After  each  predictor  selection  stage  has  been  com- 
pleted, significance  tests  are  run  upon  the  developmental 
model  to  determine  if  the  results  are  suitably  significant 
as  compared  to  random  chance.   This  testing  is  accomplished 
via  Monte  Carlo  testing  methods  using  the  conditional 
probabilities  of  the  selected  predictors  and  assuming  equal 
probability  of  occurrence  for  the  three  modified  visibility 
categories.   Functional  dependence/root-sum-square  functional 
dependence,  AO ,  and  Al  statistics  are  calculated  for  each  of 
100  randomly  generated  data  sets.   For  the  developmental 
model  to  yield  results  which  are  significant  at  the  speci- 
fied confidence  interval  values,  each  one  of  the  following 
criteria  must  be  met: 
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a.  AO  must  be  equal  to  or  greater  than  A0(96) 

b.  Al  must  be  equal  to  or  less  than  Al(05) 

c.  the  functional  dependence  value  for  a  selected 
predictor  must  be  less  than  functional 
dependence (96) 

As  with  the  process  of  selecting  equally  populous 
predictor  intervals,  the  AO ,  A0(96),  Al  and  Al(05)  statistics 
(Appendix  G) ,  reflect  scores  for  the  MAXPROB  II  strategy. 
The  AO  statistics  routinely  were  found  to  be  the  highest  for 
this  strategy  and  thus  were  used  as  the  basis  for  ensuring 
the  aforementioned  predictor  selection  criteria  were  met. 
However,  the  MAXPROB  I  strategy  often'  produced  AO  values 
identical  to  MAXPROB  II.   The  natural  regression  strategy 
regularly  lagged  the  two  maximum  probability  strategies  in 
AO  and  Al  scores  and  consequently  played  no  real  role  in  the 
prediction  selection  process.   Specific  trends  in  AO/Al 
scores  can  be  seen  in  Appendix  G. 

From  a  practical  standpoint,  the  model  development 
continues  until  computer  storage  limitations  preclude  further 
addition  of  predictors.   This  generally  occurred  at  the  fifth 
predictor  level. 

Once  the  developmental  model  is  completed,  contingency 
tables  of  forecast  visibility  category  versus  observed  visi- 
bility category  are  constructed  for  both  the  dependent  and 
independent  data  sets,  and  threat  and  skill  scores  are 
computed  and  compared. 
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2.  Preisendorfer  PR+BMD  Model 

This  model  is  still  the  PR  model  described  above. 
Now,  sets  of  three  linear  regression  equations  (Appendix  D) 
are  added  to  the  list  of  potential  NOGAPS  model  output  and 
derived  predictor  parameters.   The  inherent  difference  of 
these  predictors  is  evidenced  in  both  the  predictor  selec- 
tion process  as  well  as  in  the  resulting  skill  and  threat 
scores,  as  will  be  demonstrated  in  Chapter  V. 

3.  Equal  Variance  Threshold  Model  (EVAR) 

This  model  represents  the  first  of  two  threshold 
models,  developed  by  Lowe  (1984a),  which  were  evaluated  in 
this  study.   The  model  uses  an  algorithm  which  requires  the 
assumption  that  the  variances  of  two  normally  distributed 
populations  which  are  to  be  separated  by  a  threshold  value 
are  equal,  while  their  means  are  unequal.   A  detailed  dis- 
cussion of  the  theoretical  background  of  this  scheme  is 
addressed  in  Appendix  A.  .  " 

A  two-stage  separation  scheme  was  used  to  effectively 
divide  the  visibility  categories  (VISCAT)  I,  II  and  III 
into  a  first-stage  VISCAT  I  versus  a  combined  VISCAT  II  plus 
VISCAT  III  separation,  and  subsequently  VISCAT  II  versus 
VISCAT  III  separation  for  each  homogeneous  area  and  model 
output  time.   This  separation  was  accomplished  by  setting 
all  VISCAT  I  observations  equal  to  an  arbitrary  integer  value 
of  zero  and  the  combined  VISCAT  II  plus  VISCAT  III  observations 
equal  to  an  arbitrary  integer  value  of  one  and  generating 
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a  linear  regression  equation  to  suitably  describe  the 
resulting  two  distributions.   This  linear  regression  equation 
was  then  used  in  the  graphical  plotting  program  BMDP5D, 
from  the  BMDP  Statistical  Software  [University  of  California, 
1983] ,  to  generate  a  set  of  histograms  describing  the  first 
stage  separation.   Included  with  the  graphical  histogram 
output  is  a  listing  of  the  individual  frequency  of  observa- 
tion (P) ,  mean  (y)  and  standard  deviation  (a)  of  each  of  the 
specified  visibility  distributions.   These  statistics  are 
incorporated  into  the  equal  variance  threshold  algorithm 
and  a  corresponding  threshold  value  is  calculated. 

Following  the  first-stage  threshold  calculation,  a 
second  linear  regression  equation  is  generated,  based  upon 
only  those  VISCAT  II  plus  VISCAT  III  observations  which 
exceed  the  previously  calculated  threshold  value.   This 
effectively  eliminates  any  VISCAT  II  plus  VISCAT  III  obser- 
vations less  than  the  threshold  value  (i.e.,  those  observa- 
tions contained  in  the  tail  of  the  distribution) ,  from  being 
included  in  the  second-stage  regression.   The  previous  proce- 
dure of  generating  corresponding  histograms  and  statistics 
is  repeated,  based  upon  all  VISCAT  II  observations  being 
assigned  an  arbitrary  integer  value  of  zero  and  all  VISCAT 
III  observations  being  assigned  an  integer  value  of  one.   A 
second-stage  equal  variance  threshold  value  is  then  calcu- 
lated which  separates  VISCAT  II  from  VISCAT  III. 
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with  the  two-stage  separation  complete,  the  indepen- 
dent data  set  is  processed  through  the  governing  equations 
and  thresholds  to  obtain  a  set  of  observed  visibility  value 
results  versus  calculated  "forecast"  visibility  value  re- 
sults.  These  results,  in  contingency  table  format  for  each 
evaluated  case,  are  presented  in  Chapter  V  and  Appendix  G. 

4.  Quadratic  Threshold  Model  (QUAD) 

This  model  represents  the  second  of  two  threshold 
models,  developed  by  Lowe  (1984a),  which  were  evaluated  in 
this  study.   The  model  uses  an  algorithm  which  requires  the 
assumption  that  both  the  variances  and  the  means  of  two 
normally  distributed  populations,  which  are  to  be  separated 
by  a  threshold  value,  are  equal.   Similar  to  the  EVAR  model, 
a  detailed  discussion  of  the  theoretical  background  of  this 
scheme  is  addressed  in  Appendix  A. 

The  general  two-stage  separation  procedure  employed 
with  this  model  is  identical  to  that  described  for  the  EVAR 
model  in  IV. C.   above.   The  only  difference  between  the  QUAD 
and  EVAR  model  is  the  algorithm,  based  upon  a  solution  to 
a  quadratic  equation  in  this  model,  used  to  calculate  the 
appropriate  threshold  values. 

5 .  Maximum- Likelihood- of -Detect ion  Model 

The  maximum-likelihood-of-detection  criteria  (MLDC) 
is  an  additional  threshold  technique  which  is  included  in 
this  study  as  a  possible  alternative  to  the  aforementioned 
EVAR  and  QUAD  minimum  probable  error  threshold  models.   The 
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MLDC  involves  calculating  a  threshold  value  based  upon  the 
assumptions  that  the  population  frequencies  and  variances 
of  two  normally  distributed  samples  which  are  to  be  separated 
are  identical.   This  technique  is  particularly  well  suited 
for  cases  where  the  threat  frequency  (i.e.,  number  of 
threatening  events  divided  by  the  total  number  of  threat  and 
non-threat  events)  approaches  very  small  values  (e.g., 
statistical  rare  events) . 

Unlike  the  EVAR  and  QUAD  models,  the  two-stage 
separation  employed  with  this  technique  utilizes  a  first- 
stage  VISCAT  I+II  versus  VISCAT  III  followed  by  a  second- 
stage  VISCAT  I  versus  VISCAT  II  separation.   In  calculating 
the  specific  threshold  values,  the  lowest  frequency  visibility 
category  (usually  the  VISCAT  I  threat  category)  is  assigned 
an  arbitrary  integer  value  of  one.   The  remaining  larger 
visibility  category/ies  are  assigned  the  arbitrary  integer 
value  of  zero.   Proceeding  in  the  same  manner  as  described 
with  the  EVAR  and  QUAD  models,  population  means  are  calcu- 
lated for  each  separation  stage.   The  threshold  value  is 
simply  the  mid-point  between  the  two  population  means.   A 
detailed  discussion  of  the  theoretical  background  of  this 
scheme  is  addressed  in  Appendix  A. 
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V.   RESULTS 

The  general  procedures  outlined  in  Chapter  I  were  fol- 
lowed in  evaluating  the  statistical  scoring  techniques  for 
the  oceanic  homogeneous  areas  2,    3W  and  4.   Certain  slight 
modifications  were  required  to  handle  the  relatively  low 
frequency  of  visibility  category  I,  in  area  4  for  the  TAU- 
00,  TAU-24  and  TAU-48  model  output  data  sets.   Fig.  2 
displays  the  individual  oceanic  homogeneous  areas  for  FATJUNE 
1983.   Tables  I  through  III  identify  the  frequency  of  occur- 
rence of  visibility  categories  I,  II  and  III  at  TAU-00, 
TAU-24  and  TAU-4  8  for  each  of  the  evaluated  homogeneous 
areas. 

In  discussing  the  results  of  this  study,  specific  comment 
is  focused  upon  the  optimal  model  for  each  case  as  well  as 
any  significant  finding  observed  by  the  author.   Certain 
characteristics  of  the  evaluated  cases  are  repetitious  and 
are  considered  adequately  described  by  their  associated 
figures.   Consequently,  the  entire  assemblage  of  figures  in 
Appendix  G  are  not  individually  addressed.   These  figures 
are  nevertheless  considered  noteworthy,  as  they  document  the 
performance  of  each  tested  model  in  this  study,  and  are 
included  as  a  matter  of  record.   The  following  presentation 
of  the  results  of  this  experimentation  are  arranged  accord- 
ing to  the  specific  oceanic  homogeneous  area  and  model 
output  period. 

38 


In  general/  four  models  are  evaluated  for  each  of  the 
predefined  homogeneous  areas/model  forecast  projections.   The 
four  models  are:   the  Preisendorf er  methodology  utilizing 
NOGAPS  model  output  predictors  and  a  limited  number  of 
derived  predictors  (PR) ,  the  Preisendorf er  methodology  uti- 
lizing both  NOGAPS  model  output  predictors,  derived  predic- 
tors and  linear  regression  equation  predictors  (PR+BMD) ,  an 
equal  variance  linear  regression  threshold  model  (EVAR)  and 
a  quadratic  linear  regression  threshold  model  (QUAD) . 

A.   NORTH  ATLANTIC  OCEAN,  AREA  2 

Area  2  encompasses  a  geographic  region  that  extends  from 
the  southeastern  tip  of  Newfoundland,  across  the  North 
Atlantic  Ocean  to  the  eastern  coast  of  England,  north  to 
the  Five  Fingers  of  Iceland  and  back  to  the  Canadian  coast 
north  of  Newfoundland.   Fig.  2  gives  the  pictorial  repre- 
sentation of  the  area. 

1.   Area  2,  TAU-00 

Fig.  3  shows  the  relationship  of  equally  populous 
grouping  size  to  the  adjusted  P:0     (dependent  data)  and  the 
adjusted  VISCAT  I  threat  score  (independent  data)  for  the 
PR  model.   For  this  case,  a  grouping  size  of  eight  was  se- 
lected.  Results  of  the  individual  MAXPROB  I,  MAXPROB  II 
and  Natural  Regression  strategies  are  shown  in  Figs.  4a 
though  4c.   The  MAXPROB  II  strategy  (Fig.  4b)  produced  the 
largest  overall  independent  data  VISCAT  I  adjusted  threat 
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score,  namely  0.23  (unadjusted,  0.30).   This  peak  threat 
score  occurs  with  the  inclusion  of  the  first  predictor, 
E850,  and  declines  marginally  with  the  addition  of  the  re- 
maining four  predictors.   Of  the  three  strategies,  the 
natural  regression  strategy  (Fig.  4c),  yields  the  poorest 
overall  threat  scores  with  its  peak  threat  score  occurring 
with  the  addition  of  the  fourth  predictor.   The  predictors 
selected  for  this  case  are  E850,  ENTR,  DVDP ,  UlOOO,  and 
STRTH. 

The  associated  functional  dependence  and  AO/Al  sta- 
tistics and  96%/05%  confidence  interval  values  for  these 
predictors  are  shown  in  Fig.  5.   The  trend  of  functional 
dependence  versus  its  96%  confidence  interval  shows  that  the 
specific  functional  dependence  values  associated  with  the 
chosen  predictors  never  falls  within  the  96%  confidence 
interval.   At  the  first  predictor  level,  for  example,  the 
functional  dependence  of  ENTR  upon  E850  has  a  value  of  0.1146 
as  compared  to  a  96%  confidence  interval  value  of  0.1039. 
This  infers  that  the  corresponding  scores  (i.e.,  threat 
scores,  AO  and  Al)  are  not  statistically  significant  at  the 
preselected  96%  confidence  interval  level. 

Fig.  6  shows  the  relationship  of  equally  populous 
grouping  size  to  the  adjusted  AO  (dependent  data)  and  the 
adjusted  VISCAT  I  threat  score  (independent  data)  for  the 
PR+BMD  model.  For  this  case  an  equally  populous  grouping 
size  of  seven  was  selected.   Results  of  the  three  individual 
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Preisendorf er  strategies,  along  with  the  corresponding  con- 
tingency tables,  can  be  seen  in  Figs.  7a  through  7c.   As 
with  the  PR  model,  a  maximum  independent  VISCAT  I  threat 
score  was  obtained  with  the  MAXPROB  II  strategy  using  the 
first  predictor  selected,  namely  the  linear  regression  equa- 
tion predictor  BMDl  (Appendix  D) .   The  overall  independent 
adjusted  VISCAT  I  threat  score  achieved  with  this  model  is 
0.29  (unadjusted,  0.36),  which  is  .06  greater  than  that  for 
the  PR  model.   The  natural  regression  strategy  (Fig.  7c) 
provides  the  poorest  resultant  threat  scores  and  these  reach 
their  peak  with  the  inclusion  of  the  fifth  predictor.   The 
predictors  selected  for  this  case  are  BMDl,  ENTR,  DVDP , 
PS  and  PBLD. 

The  functional  dependence,  Al/AO  statistics  and  9  6%/ 
05%  confidence  interval  values  for  this  model  can  be  seen  in 
Fig.  8.   As  with  the  PR  model,  the  specific  functional 
dependence  values  associated  with  the  selected  predictors 
never  fall  below  the  calculated  96%  functional  dependence 
confidence  interval. 

Figs.  9  and  10  show  the  contingency  tables  results 
for  the  EVAR  and  QUAD  threshold  models.   For  each  of  these 
models  the  independent  adjusted  VISCAT  I  threat  scores  have 
identical  values  of  0.32  (unadjusted,  0.38). 

The  two-stage  linear  regression  sequence  employed 
for  both  of  these  threshold  models  yields  very  similar  basic 
statistics.   For  the  EVAR  model,  a  threshold  value  of 
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0.648497  was  calculated  for  the  first-stage  VISCAT  I  versus 
VISCAT  II+III  separation.   This  threshold  was  based  upon  a 
VISCAT  I  sample  size  of  190  observations,  a  mean  of  0.659 
and  standard  deviation  of  0.205  and  a  combined  VISCAT  II+III 
sample  size  of  1722  observations,  a  mean  of  0.927  and 
standard  deviation  of  0.122.   The  second-stage  VISCAT  II 
versus  VISCAT  III  separation  was  based  on  a  calculated 
threshold  of  0.580128.   Associated  with  this  threshold  value 
were  311  VISCAT  II  observations  with  a  mean  of  0.708  and 
standard  deviation  of  0.142  and  1473  VISCAT  III  observations 
with  a  mean  of  0.850  and  standard  deviation  of  0.131. 

For  the  QUAD  model,  a  threshold  value  of  0.642104 
was  calculated  for  the  VISCAT  I  versus  VISCAT  II+III  first- 
stage  separation,  based  upon  the  sample  addressed  above.   A 
second-stage  quadratic  threshold  separating  the  VISCAT  II 
and  VISCAT  III  samples  was  calculated  to  be  0.580569.   This 
VISCAT  II  sample  contained  358  observations  with  a  mean  of 
0.643  and  standard  deviation  of  0.142  while  the  VISCAT  III 
sample  contained  1402  observations  with  a  mean  of  0.846  and 
standard  deviation  of  0.140. 

While  no  significant  difference  appears  to  exist 
between  the  results  of  the  two  threshold  models,  the  QUAD 
model  yields  a  slightly  higher  AO  and  slightly  lower  Al 
values  for  both  the  dependent  and  independent  data  sets. 

Table  V  shows  a  synopsis  of  the  key  statistical 
results  for  this  case.   The  best  models,  as  determined  by 
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independent  adjusted  VISCAT  I  threat  scores,  are  the  two 
threshold  models.   Of  these  two  models,  the  QUAD  model 
achieves  the  highest  adjusted  AO ,  namely  3.16%  (unadjusted, 
80.73%)  . 

2.   Area  2,  TAU-24 

Fig.  11  shows  the  relationship  of  equally  populous 
grouping  size  to  the  adjusted  AO  (dependent  data)  and  the 
adjusted  VISCAT  I  threat  score  (independent  data)  for  the 
PR  model.   For  this  model,  adjusted  dependent  AO  values  of 
-0.03  and  adjusted  independent  threat  score  of  -.01  were 
obtained  for  grouping  sizes  four  through  nine.   At  the 
grouping  size  of  ten,  a  jump  in  scores  was  realized  and 
thus  ten  is  identified  as  the  only  possible  selection.   An 
associated  difficulty  in  utilizing  a  grouping  size  of  eight, 
nine  or  ten,  is  that  local  computer  storage  resources  are 
limited  to  two  megabytes.  This  decreases  the  usual  five 
predictor  array  to  only  four  predictors  as  witnessed  in  this 
case.   The  results  of  the  three  Preisendorf er  strategies  are 
shown  in  Figs.  12a  through  12c.   For  this  model,  the  MAXPROB 
I  and  MAXPROB  II  strategies  yield  identical  maximum  independent 
adjusted  VISCAT  I  threat  scores  of  0.21  (unadjusted,  0.27). 
For  each  of  the  maximum  probability  strategies,  an  initial 
threat  score  of  0.19  (unadjusted,  0.25)  was  achieved  with 
the  first  predictor,  E850,  solely.   The  slight  increase  to 
the  overall  peak  threat  score  was  obtained  with  the  inclusion 
of  the  second  predictor,  ENTR,  with  subsequent  independent 


43 


VISCAT  I  threat  scores  decreasing  at  the  third  and  fourth 
predictor  levels.   Of  the  three  strategies,  natural  regression 
(Fig.  12c)  yielded  the  poorest  overall  threat  score  and  per- 
cent correct  values.   These  relative  peak  scores  for  the 
natural  regression  strategy  occur  with  the  inclusion  of  the 
fourth  and  final  predictor.   The  predictors  selected  for  this 
model  were:   E850,  ENTR,  DVDP  and  DIV9  25. 

The  associated  functional  dependence,  AO/Al  statis- 
tics and  96%/05%  confidence  intervals  for  this  model  are 
shown  in  Fig.  13.   For  this  case,  the  third  and  fourth  pre- 
dictors' root-sum-square  functional  dependence  values  exceed 
the  associated  96%  confidence  interval  values,  indicating 
significant  statistical  interdependence  of  these  predictors 
at  this  confidence  interval  level. 

Fig.  14  shows  the  relationship  of  equally  populous 
grouping  size  to  the  adjusted  AO  (dependent  data)  and  the 
adjusted  VISCAT  I  threat  score  (independent  data)  for  the 
PR+BMD  model.   The  dramatic  increase  in  independent  threat 
score  at  grouping  size  of  seven  identifies  it  as  the  optimal 
selection.   The  results  of  the  three  Preisendorf er  strategies 
are  shown  in  Figs.  15a  through  15c.   For  this  model,  the 
MAXPROB  I  and  MAXPROB  II  strategies  yield  identical  maximum 
independent  adjusted  VISCAT  I  threat  scores  of  0.26  (unad- 
justed, 0.32) .   This  peak  score  was  achieved  with  the  inclu- 
sion of  the  first  predictor.   In  this  case,  the  first  selected 
predictor  is  the  second  generated  linear  regression  equation 
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predictor,  BMD2  (Appendix  D) .   Following  the  initial  threat 
score  maxima,  the  scores  decreased  with  the  addition  of  the 
subsequent  four  predictors.   While  some  fluctuation  in  the 
threat  score  trend  was  observed  with  the  MAXPROB  II  strategy, 
independent  VISCAT  I  threat  scores  never  surpassed  their 
initial  maximum  value.   Of  the  three  strategies,  natural 
regression  (Fig.  15c)  provides  the  poorest  overall  indepen- 
dent VISCAT  I  threat  score  of  0.21  (unadjusted,  0.28).   This 
score  was  achieved  with  the  addition  of  the  fifth  and  final 
predictor.   The  predictors  selected  for  this  model  were: 
BMD2,  VRT925,  ENTR,  UlOOO  and  RH. 

The  associated  functional  dependence,  AO/Al  statis- 
tics and  96%/05%  confidence  intervals  are  shown  in  Fig.  16. 
For  this  model,  a  comparison  of  functional  dependence  and 
functional  dependence  96%  confidence  interval  values  indi- 
cates that  the  final  three  predictors  have  root-sum-square 
functional  dependence  values  which  are  too  large  to  ensure 
significant  statistical  independence  at  the  96%  confidence 
interval  level. 

Figs.  17  and  18  show  the  contingency  tables  and 
associated  statistics  for  the  EVAR  and  QUAD  threshold  models. 
For  each  of  the  models,  the  independent  adjusted  VISCAT  I 
threat  scores  have  identical  values,  namely  0.29  (unadjusted, 
0.24).   The  two-stage  linear  regression  sequence  employed 
for  both  of  these  models  yields  fairly  similar  statistical 
results.   For  the  EVAR  model,  a  threshold  value  of  0.674932 
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was  calculated  for  the  first-stage  VISCAT  I  versus  VISCAT 
II+III  separation  based  upon  a  VISCAT  I  sample  size  of  180, 
a  mean  of  0.682  and  a  standard  deviation  of  0.227  and  a 
VISCAT  II+III  sample  size  of  1580,  a  mean  of  0.938  and  a 
standard  deviation  of  0.109.   The  second-stage  VISCAT  II 
versus  VISCAT  III  separation  was  based  upon  a  calculated 
threshold  value  of  0.601717.   Associated  with  this  threshold 
were  300  VISCAT  II  observations  with  a  mean  of  0.733  and 
standard  deviation  of  0.149  and  1339  VISCAT  III  observations 
with  a  mean  of  0.857  and  standard  deviation  of  0.121. 

For  the  QUAD  model,  a  threshold  value  of  0.675210 
was  calculated  for  the  first-stage  VISCAT  I  versus  VISCAT 
II+III  separation  based  upon  the  sample  statistics  addressed 
above.   The  second-stage  threshold  separating  the  VISCAT  II 
and  VISCAT  III  samples  was  calculated  to  be  0.617455.   The 
VISCAT  II  sample  contained  300  observations  with  a  mean  of 
0.739  and  a  standard  deviation  of  0.125.   The  VISCAT  III 
sample  contained  1339  observations  with  a  mean  of  0.885  and 
standard  deviation  of  0.118. 

While  the  VISCAT  I  threat  scores  for  both  the  dependent 
and  independent  data  sets  are  identical  for  the  two  models , 
differences  in  other  statistics  are  apparent.   The  EVAR  model 
(Fig.  17),  for  example,  has  the  higher  independent  adjusted 
AO  scores,  namely  2.96%  (unadjusted,  81.34%),  as  compared  to 
scores  of  -63.31%  (unadjusted,  68.60%)  for  the  QUAD  model 
(Fig.  18)  . 
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In  general,  for  area  2,  TAU-24,  the  threshold  models 
again  provide  the  highest  independent  VISCAT  I  threat  scores 
(Table  V).   Of  the  two  threshold  models,  the  EVAR  model  has 
a  slight  edge  in  AO  scores. 
3.   Area  2,  TAU-4  8 

Fig.  19  shows  the  relationship  of  equally  populous 
grouping  size  to  the  adjusted  AO  (dependent  data)  and  the 
adjusted  VISCAT  I  threat  score  (independent  data)  for  the 
PR  model.   For  this  model,  the  initial  peak  values  of  dependent 
AO  and  independent  VISCAT  I  threat  score  at  the  grouping 
size  of  four  did  not  sufficiently  ascertain  four  as  the 
optimal  grouping  selection.   For  this  grouping  size,  the 
second  selected  predictor  ENTR  had  a  functional  dependence 
of  0.2952  as  compared  to  the  calculated  functional  dependence 
96%  confidence  interval  value  of  0.1932.   The  large  dis- 
parity between  the  two  functional  dependence  values  indicates 
a  significant  statistical  correlation  between  E850  and  ENTR 
at  a  grouping  size  of  four  and  thus  grouping  size  four  was 
dropped  from  consideration.   The  selected  grouping  size  of 
nine,  which  unfortunately  carries  with  it  the  requirement 
of  a  very  large  computer  storage  forecast  array  at  the  fifth 
predictor  level,  had  a  functional  dependence  value  0.09  30 
as  compared  to  a  functional  dependence  9  6%  confidence  interval 
value  of  0.0970  and  thus  was  selected  as  the  optimal  grouping 
size.   The  associated  functional  dependence,  AO/Al  statistics 
and  96%  confidence  intervals  are  shown  in  Fig.  20.   The  first 
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three  predictors  selected  have  functional  dependence  values 
sufficiently  low  enough  to  ensure  no  significant  predictor 
interdependence . 

The  results  of  the  three  Preisendorf er  strategies 
are  shown  in  Figs.  21a  through  21c.   The  maximum  independent 
VISCAT  I  threat  score  achieved  for  the  three  strategies  was 
0.17  (unadjusted,  0.26)  and  was  obtained  with  the  MAXPROB  II 
strategy  with  the  addition  of  the  fifth  predictor.   It  should 
be  noted  that  the  independent  adjusted  VISCAT  I  threat 
scores  achieved  by  both  the  MAXPROB  I  and  MAXPROB  II  strate- 
gies reached  near  peak  values  of  0.16  (unadjusted,  0.24) 
with  the  addition  of  the  second  predictor,  thus  greatly  mini- 
mizing the  size  of  the  associated  forecast  array.   Of  the 
three  strategies,  natural  regression  (Fig.  21c)  yielded  the 
poorest  overall  adjusted  independent  VISCAT  I  threat  score, 
namely  0.09  (unadjusted,  0.18).   This  score  was  achieved 
with  the  inclusion  of  the  fourth  predictor  in  the  forecast 
array.   The  predictors  selected  for  this  model  were  E850, 
ENTR,  DVDP,  DRAG  and  DIV9  25. 

Fig.  22  shows  the  relationship  of  equally  populous 
grouping  size  to  the  adjusted  AO  (dependent  data)  and  the 
adjusted  VISCAT  I  threat  score  (independent  data)  for  the 
PR+BMD  model.   For  this  model  a  grouping  size  of  nine  was 
selected.   The  results  of  the  MAXPROB  I,  MAXPROB  II  and 
natural  regression  strategies  are  shown  in  Figs.  23a  through 
23c.   For  this  model,  MAXPROB  I  and  MAXPROB  II  provide 
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identical  maximum  independent  adjusted  VISCAT  I  threat  scores 
of  0.31  (unadjusted,  0.37).   These  scores  were  achieved  with 
the  inclusion  of  the  second  linear  regression  equation  pre- 
dictor BMD2  (Appendix  D) .   For  each  of  these  strategies,  the 
independent  VISCAT  I  threat  scores  decrease  with  the  addi- 
tion of  the  second  and  subsequent  predictors.   While  a  slight 
upward  progression  is  noticed  with  the  MAXPROB  II  strategy, 
the  peak  score  observed  at  the  first  predictor  level  is 
never  surpassed.   Of  the  three  Preisendorf er  strategies, 
natural  regression  (Fig.  23c),  yields  the  poorest  overall 
independent  VISCAT  I  threat  score,  namely  0.18  (unadjusted, 
0.26).   This  score  occurs  with  the  inclusion  of  the  fifth 
predictor  and  culminates  in  a  slow  increase  in  threat  score 
as  each  predictor  is  sequentially  added  to  the  forecast  array, 
The  predictors  selected  for  this  model  were  BMD2,  VRT925, 
ENTR,  U500  and  DRAG. 

Fig.  24  shows  the  functional  dependence,  AO/Al  sta- 
tistics and  96%/05%  confidence  interval  values  for  the 
selected  predictors.   For  this  model,  the  second  and  third 
predictors'  functional  dependence  values  fall  below  the  96% 
confidence  interval  and  thus  are  not  significantly  inter- 
dependent upon  one  another.   This  trend  changes  with  the 
fourth  and  fifth  predictors  which  have  functional  dependence 
values  greater  than  the  calculated  96%  confidence  interval 
values . 

Figs.  25  and  26  show  the  contingency  table  results 
for  the  EVAR  and  QUAD  threshold  models.   For  each  of  these 
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models,  the  independent  adjusted  VISCAT  I  threat  scores 
have  identical  values  of  0.21  (unadjusted,  0.29). 

The  two-stage  linear  regression  sequence  used  to 
separate  the  three  visibility  categories  yield  very  similar 
results  for  the  two  threshold  models.   For  the  EVAR  model, 
a  threshold  value  of  0.652554  was  calculated  for  the  first- 
stage  VISCAT  I  versus  VISCAT  II+III  sample  separation. 
This  threshold  value  is  based  upon  a  VISCAT  I  sample  size 
of  182  observations  with  a  mean  of  0.686  and  a  standard 
deviation  of  0.267  and  a  combined  VISCAT  II+III  sample  of 
1670  observations  with  an  associated  mean  of  0.930  and 
standard  deviation  of  0.106.   The  second  stage  VISCAT  II 
versus  VISCAT  III  regression  separation  yielded  a  threshold 
value  of  0.572257  based  upon  355  VISCAT  II  observations,  with 
a  mean  of  0.711  and  standard  deviation  0.135,  and  1408 
VISCAT  III  observations  with  a_ mean  of  0.834  and  a  standard 
deviation  of  0.130.  ,  " 

For  the  QUAD  model,  a  very  similar  threshold  value 
of  0.652554  was  calculated  for  the  first-stage  VISCAT  I 
versus  VISCAT  II+III  separation  based  upon  the  sample  first- 
stage  statistics  addressed  above.   A  second-stage  threshold 
value  of  0.564579  was  calculated  based  upon  330  VISCAT  II 
observations  with  a  mean  of  0.724  and  standard  deviation  of 
0.128,  and  1407  VISCAT  III  observations  with  a  mean  of  0.833 
and  a  standard  deviation  of  0.127. 
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In  general,  the  results  of  these  two  threshold  models 
are  nearly  identical.   The  EVAR  model  shows  a  very  slight 
advantage  in  adjusted  independent  AO  scores,  namely  7.07% 
(unadusted,  80.11%)  as  compared  to  5.05%  (unadjusted, 
79.68%)  for  the  QUAD  model.   Similarly,  the  EVAR  model  yielded 
a  slightly  higher  independent  adjusted  threat  score  for  VISCAT 
I  combined  with  VISCAT  II  of  0.02  (unadjusted,  0.23)  versus 
an  adjusted  score  of  0.01  (unadjusted,  0.22)  for  the  QUAD 
model . 

For  Area  2,  TAU-48  the  PR+BMD  model  provides  the 
highest  overall  independent  VISCAT  I  threat  score  (Table  V) . 
The  difference  between  the  independent  adjusted  VISCAT  I 
threat  scores  for  the  PR+BMD  model  and  the  two  threshold 
models  is  minimal,  namely  0.02,  while  the  PR  model  is  0.14 
lower . 

B.   NORTH  ATLANTIC  OCEAN,  AREA  3W 

Area  3W  was  the  North  Atlantic  homogeneous  area  selected 
by  Karl  (1984)  for  his  initial  TAU-00  MOS  experimentation. 
This  area  borders  the  United  State's  eastern  seaboard  from 
the  vicinity  of  Cape  Charles,  Virginia  to  the  southeastern 
tip  of  Newfoundland.   The  area  encompasses  a  large  portion 
of  the  Georges  Banks  region  and  extends  to  approximately 
45°  W  longitude.   The  specific  detail  and  proximity  of  this 
area  can  be  seen  in  Fig.  2. 

Area  3W  constitutes  the  homogeneous  area  with  the  highest 
relative  frequency  of  VISCAT  I  observations  with  approximately 
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19%  of  the  total  number  of  visibility  observations  being  less 
than  2  kilometers  in  the  TAU-00,  TAU-24  and  TAU-48  periods. 
The  TAU-24  and  TAU-48  prognostic  periods  will  be  addressed 
in  this  document.   The  reader  is  advised  to  consult  Karl 
(1984)  for  detailed  information  concerning  area  3W ,  TAU-00. 
1.   Area  3W,  TAU-24 

Fig.  27  shows  the  relationship  of  equally  populous 
grouping  size  to  the  adjusted  AO  (dependent  data)  and  the 
adjusted  VISCAT  I  threat  score  (independent  data)  for  the 
PR  model.   For  this  case  a  grouping  size  of  six  was  selected. 
Results  of  the  three  Preisendorf er  strategies  are  shown  in 
Figs.  28a  through  28c.   The  MAXPROB  II  strategy  achieves  a 
slightly  higher  independent  adjusted  VISCAT  I  threat  score 
of  0.21  (unadjusted,  0.36)  as  compared  to  a  score  of  0.20 
(unadjusted,  0.35)  for  the  MAXPROB  I  method.   For  each  of 
these  strategies,  the  maximum  threat  score  is  reached  with 
the  inclusion  of  the  fifth  and  final  predictor  in  the  fore- 
cast array.   The  general  trend  of  these  two  strategies  is 
nearly  identical  and  show  an  initial  rise  in  threat  score 
at  the  first  predictor  level,  a  slight  decrease  with  the 
addition  of  the  second  and  third  predictors  and  a  secondary 
rise  at  the  fourth  and  fifth  predictor  levels.   The  poorest 
results  for  this  case  were  achieved  with  the  natural  regres- 
sion strategy  (Fig.  28c) ,  for  which  an  independent  adjusted 
VISCAT  I  threat  score  of  0.16  (unadjusted,  0.32)  was  achieved 
This  score  was  similarly  reached  with  the  addition  of  the 
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fifth  and  final  predictor.   The  predictors  selected  for  this 
model  were  DTDP,  SHWRS ,  ENTR,  UlOOO  and  DUDP . 

Fig.  29  shows  the  functional  dependence,  AO/Al 
statistics  and  96%/05%  confidence  intervals  for  this  model. 
For  this  case  only  the  second  predictor  has  a  functional 
dependence  value  which  falls  below  the  corresponding  9  6% 
confidence  interval  and  thus  meets  the  requisite  conditions 
regarding  predictor  interdependence.   Consequently,  the 
greatest  independent  threat  score  achieved,  which  coinci- 
dently  meets  the  functional  dependence  criteria,  occurs  with 
the  MAXPROB  II  strategy  at  the  inclusion  of  the  second  pre- 
dictor.  The  threat  score  achieved  in  this  particular  instance 
has  a  value  of  0.13  (unadjusted,  0.30). 

Fig.  30  shows  the  relationship  of  equally  populous 
grouping  size  to  the  adjusted  AO  (dependent  data)  and  the 
adjusted  VISCAT  I  threat  score  (independent  data)  for  the 
PR+BMD  model.   For  this  case  a  grouping  size  of  five  was 
selected.   Results  of  the  MAXPROB  I,  MAXPROB  II  and  natural 
regression  strategies  are  shown  in  Figs.  31a  through  31c. 
For  this  model,  the  two  maximum  probability  strategies  pro- 
vide identical  peak  independent  adjusted  VISCAT  I  threat 
scores  of  0.28  (unadjusted,  0.42)  at  the  first  predictor 
level.   For  both  of  these  strategies,  the  addition  of  subse- 
quent predictors  produces  a  steady  drop  off  in  threat  score 
values.   The  poorest  overall  results  for  this  case  are 
achieved  with  the  natural  regression  strategy  (Fig.  31c). 
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This  method  yields  an  independent  adjusted  VISCAT  I  threat 
score  of  0.17  (unadjusted,  0.33)  which  was  obtained  with  the 
addition  of  the  fifth  and  final  predictor.   The  predictors 
selected  for  this  model  were  BMDl,  D500,  DVDP ,  ENTR  and 
U850. 

Fig.  32  shows  the  associated  functional  dependence, 
Al/AO  statistics  and  96%/05%  confidence  interval  values  for 
the  predictors  chosen  for  this  model.   The  functional  depen- 
dence versus  the  96%  confidence  interval  follows  a  peculiar 
trend  where  the  second  predictor  is  significantly  dependent 
upon  the  first  predictor  but  the  third  and  fourth  predictors 
are  conversely  sufficiently  uncorrelated  with  the  prior 
predictors  to  ensure  no  significant  functional  dependence. 
The  final  predictor  returns  to  being  functionally  dependent 
upon  the  previous  predictors.   This  trend  indicates  that  the 
relative  contribution  of  the  second  and  subsequent  predictors 
is  statistically  hot  significant  at  the  preselected  96% 
confidence  interval  level. 

Figs.  33  and  34  show  the  contingency  table  results 
for  the  EVAR  and  QUAD  threshold  models.   The  results  of  these 
models  are  very  similar  with  the  EVAR  model  yielding  an 
independent  adjusted  VISCAT  I  threat  score  of  0.17  (unad- 
justed, 0.33)  as  compared  to  a  corresponding  threat  score 
of  0.16  (unadjusted,  0.32)  for  the  QUAD  model. 

For  the  EVAR  model,  a  first-stage  threshold  value  of 
0.561855  was  calculated  based  upon  270  VISCAT  I  observations 
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with  a  mean  of  0.590  and  standard  deviation  of  0.203  and 
1145  VISCAT  II+III  observations  with  a  mean  of  0.861  and 
standard  deviation  of  0.168.  The  second-stage  VISCAT  II 
versus  VISCAT  III  separation  was  based  upon  a  calculated 
threshold  value  of  0.542363.  Associated  with  this  threshold 
were  299  VISCAT  II  observations  with  a  mean  of  0.647  and 
standard  deviation  of  0.146  and  938  VISCAT  III  observations 
with  a  mean  of  0.794  and  standard  deviation  of  0.153. 

For  the  QUAD  model,  a  similar  threshold  value  of 
0.5559971  was  calculated  based  upon  the  first-stage  regres- 
sion separation  listed  above.   A  second-stage  threshold 
value  of  0.540874,  separating  VISCAT  II  from  VISCAT  III,  was 
calculated  based  upon  30  5  VISCAT  II  observations  with  a  mean 
of  0.639  and  standard  deviation  of  0.157  and  940  VISCAT  III 
observations  with  a  mean  of  0.793  and  standard  deviation 
of  0.154. 

In  general,  the  PR+BMD  model  produced  the  best  overall 
results  for  this  case,  followed  by  the  PR  model  and  lastly 
the  two  threshold  models  (Table  V) .   The  independent  adjusted 
AO  score  of  the  PR+BMD  model,  which  corresponds  to  the  maxi- 
mum independent  adjusted  VISCAT  I  threat  score,  is  similarly 
a  maximum  value  for  this  case,  namely  21.68%  (unadjusted, 
74.96%) . 

2.   Area  3W,  TAU-4  8 

Fig.  35  shows  the  relationship  of  equally  populous 
grouping  size  to  the  adjusted  AO  (dependent  data)  and  the 
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adjusted  VISCAT  I  threat  score  (independent  data)  for  the  PR 
model.   For  this  model,  an  equally  populous  grouping  size  of 
six  was  selected.   The  results  of  the  three  Preisendorf er 
strategies  are  shown  in  Figs.  36a  through  36c.   For  this 
case,  the  MAXPROB  II  strategy  achieves  the  highest  indepen- 
dent adjusted  VISCAT  I  threat  score  of  0.18  (unadjusted, 
0.33)  as  compared  to  0.17  (unadjusted,  0.32)  for  the  MAXPROB 
I  strategy  and  0.12  (unadjusted,  0.22)  for  natural  regression, 
The  maximum  score  for  each  of  the  three  methods  was  achieved 
with  the  addition  of  the  fifth  and  final  predictor.   The 
statistical  score  trends  for  the  two  maximum  probability 
strategies  are  very  similar  and  reach  identical  near  peak 
independent  VISCAT  I  threat  scores  of  0.15  (unadjusted,  0.30) 
at  the  first  predictor  level.   This  is  particularly  note- 
worthy when  considering  that  the  computer  forecast  array 
size  may  be  of  significant  operational  concern.   The  poorest 
strategy  for  this  case  is  natural  regression.   The  predictors 
selected  for  this  case  are  DTDP,  SHWRS ,  ENTR,  U850  and 
DIV925. 

Fig.  37  shows  the  functional  dependence,  AO/Al  sta- 
tistics and  96%/05%  confidence  interval  values  for  this 
model.   In  this  case,  only  the  second  predictor  strictly 
meets  the  requisite  functional  dependence  criteria  ensuring 
no  significant  dependence  of  one  predictor  upon  another.   The 
MAXPROB  II  independent  adjusted  AO  score,  which  corresponds 
to  the  peak  independent  VISCAT  I  threat  score  for  this  case. 
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is  -2.47%  (unadjusted,  66.49%)  as  compared  to  AO  scores  of 
4.94%  (unadjusted,  68.91%)  for  MAXPROB  I  and  -16.87%  (unad- 
justed, 61.78%)  for  natural  regression. 

Fig.  38  shows  the  relationship  of  equally  populous 
grouping  size  to  the  adjusted  AO  (dependent  data)  and  the 
adjusted  VISCAT  I  threat  score  (independent  data)  for  the 
PR+BMD  model.   For  this  case  a  grouping  size  of  five  was 
selected.   The  results  of  the  three  Preisendorf er  strategies 
are  shown  in  Figs.  39a  through  39c.   For  this  case,  the 
MAXPROB  II  strategy  provides  the  highest  independent  ad- 
justed VISCAT  I  threat  score  of  0.30  (unadjusted,  0.43). 
This  peak  score  slightly  surpasses  the  score  of  0.29 
(unadjusted,  0.42)  achieved  by  the  MAXPROB  I  method.   The 
trends  for  these  two  strategies  are  nearly  identical,  showing 
only  a  slight  oscillation  in  independent  threat  scores  as 
predictors  are  added.   The  peak  score  achieved  by  the  MAXPROB 
II  scheme  is  at  the  fifth  predictor  level  while  the  peak 
value  for  MAXPROB  I  is  obtained  with  the  inclusion  of  the 
first  predictor.   It  should  be  noted  that  the  results  at 
the  first  predictor  level  for  the  two  maximum  probability 
strategies  are  identical.   A  forecast  array  predicated  upon 
a  one  predictor  versus  five  predictor  array  size  requires 
four  orders  of  magnitude  less  computer  storage  resources  and 
is  therefore  a  desirable  characteristic  for  an  operational 
forecast  system.   Additionally,  the  independent  adjusted 
AO  scores,  achieved  by  both  schemes,  have  identical  maximum 
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values  of  19.25%  (unadjusted,  73.76%)  at  the  first  predictor 
level  as  compared  to  a  maximum  value  of  12.76%  (unadjusted, 
71.47%)  for  the  natural  regression  strategy  at  the  fifth 
predictor  level.   The  poorest  strategy  for  this  case  is 
natural  regression  (Fig.  39c).   The  independent  VISCAT  I 
threat  scores  for  this  scheme  initially  yield  very  low  threat 
score  values  at  the  first  and  second  predictor  levels  with  a 
subsequent  rapid  rise  at  the  third,  fourth  and  fifth  predic- 
tor levels.   This  rapid  rise  however  produces  a  threat  score 
value  of  only  0.19  (unadjusted,  0.34)  and  a  corresponding  AO 
of  -1.65%  (unadjusted,  66.76%)  at  the  fifth  and  final  predictor 
level.   The  predictors  selected  for  this  model  are  BMD2, 
UlOOO,  ENTR,  DVDP  and  EAIR. 

Fig.  40  shows  the  functional  dependence,  AO/Al  sta- 
tistics and  96%/05%  confidence  interval  values  for  this  model. 
For  this  case,  three  of  the  five  selected  predictors  do  not 
meet  the  96%  confidence  interval  criteria  for  functional 
independence.   This  further  justifies  the  use  of  a  single 
predictor  forecast  array  for  possible  operational  use. 

Figs.  41  and  42  show  the  contingency  table  results 
for  the  EVAR  and  QUAD  threshold  models.   The  results  of  these 
two  models  are  very  similar  with  the  EVAR  model  showing  a 
slight  advantage  in  independent  adjusted  VISCAT  I  threat 
score  of  0.15  (unadjusted,  0.33)  versus  0.14  (unadjusted, 
0.31)  for  the  QUAD  model.   Similarly,  the  EVAR  model  achieves 
a  slightly  higher  independent  adjusted  AO  of  13.17% 
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(unadjusted,  71.60%)  versus  12.76%  (unadjusted,  71.47%) 
for  the  QUAD  model. 

For  the  EVAR  model,  a  first-stage  regression  thres- 
hold value  of  0.577452  was  calculated  based  upon  a  VISCAT  I 
sample  size  of  290  observations  with  a  mean  of  0.620  and 
standard  deviation  of  0.211  and  a  combined  VISCAT  II+III 
sample  size  of  1197  observations  with  a  mean  of  0.860  and 
standard  deviation  of  0.153.   A  second-stage  threshold  value 
of  0.548587  separating  VISCAT  II  and  VISCAT  III  was  calcu- 
lated based  upon  a  VISCAT  II  sample  size  of  328  with  a  mean 
of  0.654  and  standard  deviation  of  0.142  and  971  VISCAT  III 
observations  with  a  mean  of  0.777  and  standard  deviation  of 
0.136. 

The  first-stage  threshold  value  of  0.572592  for  the 
QUAD  model  was  generated  with  the  above  VISCAT  I  versus 
VISCAT  II+III  sample  statistics.   A  second-stage  threshold 
value  of  0.548717  was  based  upon  333  VISCAT  II  observations 
with  a  mean  of  0.649  and  standard  deviation  of  0.138. 

In  general,  the  model  which  produces  the  highest 
independent  VISCAT  I  threat  score  for  this  case  is  the 
PR+BMD  model  while  the  highest  independent  AO  score  is 
achieved  with  the  EVAR  threshold  model  (Table  V) .   The  rela- 
tively large  independent  threat  score  dominates  the  scores 
however,  and  therefore  the  PR+BMD  model  is  determined  to  be 
the  optimal  model  in  this  case. 
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C.   NORTH  ATLANTIC  OCEAN,  AREA  4 

Area  4  was  selected  for  evaluation  because  of  its  rela- 
tively low  frequency  (approximately  3%  of  the  total)  of 
VISCAT  I  observations.   It  was  hoped  that  this  area  would 
statistically  represent  a  region  where  there  was  an  insuffi- 
cient number  of  VISCAT  I  observations  to  allow  for  study  of 
a  forecast  region  where  results  were  anticipated  to  be  poor, 
yet  enough  VISCAT  I  observations  to  avoid  any  "rare  event" 
statistical  entanglements. 

This  area  encompasses  a  broad  region  of  the  North  Atlantic 
Ocean  which  is  generally  to  the  south  of  area  2  and  east  and 
southeast  of  area  3W.   Area  4's  southern  border  reaches  to 
the  northeastern  tip  of  Portugal  and  extends  northward  through 
the  English  Channel  to  encompass  the  southern  portion  of  the 
North  Sea. 

1.   Area  4,  TAU-OQ 

Fig.  43  shows  the  relationship  of  equally  populous 
grouping  size  to  the  adjusted  AO  (dependent  data)  and  the 
adjusted  VISCAT  I  threat  score  (independent  data)  for  the 
PR  model.   Several  unique  characteristics  were  encountered 
for  this  case  which  had  not  been  previously  been  observed. 
The  previously  observed  variation  of  dependent  AO  and  inde- 
pendent threat  scores,  associated  with  the  sequential  varia- 
tion in  grouping  size  from  four  through  ten,  was  not  initially 
achieved.   For  this  case,  non-zero  values  of  dependent  AO 
and  independent  VISCAT  I  threat  score  were  only  achieved 


60 


after  three  iterations  of  the  predictor  selection  procedure. 
The  grouping  size  of  four  was  deleted  from  consideration 
in  the  third  iteration  because  the  associated  AO  value, 
achieved  at  that  predictor  level,  did  not  exceed  the  previous 
AO  value  at  the  second  predictor  level.   For  this  case,  the 
independent  VISCAT  I  threat  scores  maintained  indentically 
low  values,  while  a  relative  peak  in  AO  was  achieved  at  a 
grouping  size  of  eight.   For  this  reason,  eight  was  selected 
as  the  optimal  grouping  size  for  this  model. 

Figs.  44a  through  44c  represent  the  results  of  the 
three  Preisendorf er  strategies.   For  each  of  the  schemes, 
the  independent  VISCAT  I  threat  scores  at  the  first  three 
predictor  levels  reveal  the  near-zero  scores  encountered  in 
the  grouping  size  selection  process.   The  highest  independent 
adjusted  VISCAT  I  threat  score,  namely  0.08  (unadjusted, 
0.11)  is  achieved  with  the  MAXPROB  II  strategy  at  the  fifth 
and  final  predictor  level.   For  this  model,  the  MAXPROB  I 
and  natural  regression  strategies  yield  only  slightly  inferior, 
identical  independent  adjusted  threat  scores  of  0.04  (inad- 
justed,  0.07)  which  are  achieved  at  the  fifth  predictor 
level.   The  MAXPROB  I  strategy  yields  the  highest  independent 
adjusted  AO  score  of  -15.77%  (unadjusted,  82.45%)  as  compared 
to  scores  of  -28.63%  (unadjusted,  80.50%)  for  natural 
regression  and  -34.85%  (unadjusted,  79.56%)  for  the  MAXPROB 
II  strategy.   The  predictors  selected  for  this  model  are 
V500,  DVDP,  STRTTH,  E500  and  ENTR. 
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Fig.  45  shows  the  functional  dependence,  AO/Al  sta- 
tistics and  96%/05%  confidence  interval  values  for  this  model. 
In  this  particular  case,  only  the  third  predictor  displays 
a  functional  dependence  value  less  than  the  9  6%  confidence 
interval  value.   This  renders  the  threat  scores  achieved  by 
this  model,  beyond  the  first  predictor  level,  statistically 
not  significant,  if  strict  adherence  to  the  basic  functional 
dependence  criteria  is  followed. 

Fig.  46  shows  the  relationship  of  equally  populous 
grouping  size  to  the  adjusted  AO  (dependent  data)  and  the 
adjusted  VISCAT  I  threat  score  (independent  data)  for  the 
PR+BMD  model.   For  this  case  a  grouping  size  of  nine  was 
selected.   The  results  of  the  three  Preisendorfer  strategies 
are  shown  in  Figs.  47a  through  47c.   Generally,  the  results 
for  this  model  differ  very  little  from  the  previously  dis- 
cussed PR  model.   This  case  reflects  the  first  and  only 
occurrence  where  the  Preisendorfer  methodology  coupled  with 
linear  regression  equation  predictors  (PR+BMD  model)  did  not 
yield  superior  results  to  the  PR  model.   The  trends  for 
these  three  strategies  are  generally  quite  similar.   The 
MAXPROB  II  scheme  provides  the  highest  independent  adjusted 
VISCAT  I  threat  score  of  0.09  (unadjusted,  0.11),  as  com- 
pared to  scores  of  0.08  (unadjusted,  0.11)  for  MAXPROB  I 
and  0.07  (unadjusted,  0.10)  for  natural  regression.   For  each 
of  these  three  strategies,  the  maximum  independent  VISCAT  I 
threat  score  was  achieved  with  the  inclusion  of  the  fifth 
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and  final  predictor.   The  independent  AO  scores  associated 
with  the  peak  threat  scores  are  near  their  lowest  values  at 
the  fifth  predictor  level  with  the  MAXPROB  I  scheme  yielding 
the  highest  relative  independent  adjusted  AO  of  -19.09% 
(unadjusted,  81.95%)  followed  by  natural  regression  with  a 
score  of  -26.56%  (unadjusted,  80.82%)  and  lastly  MAXPROB  II 
with  a  score  of  -39.42%  (unadjusted,  78.87%).   The  predictors 
selected  for  this  model  are  BMD2,  DUDP,  ENTR,  DEDP  and 
UIOOO. 

Fig.  48  shows  the  functional  dependence,  AO/Al  sta- 
tistics and  96%/05%  confidence  interval  values  for  this 
model.   Generally,  the  relative  difference  between  the  func- 
tional dependence  and  96%  functional  dependence  confidence 
interval  values  is  much  less  severe  than  with  the  previously 
discussed  model.   While  only  the  third  predictor's  functional 
dependence  value  meets  the  96%  confidence  interval  criteria 
for  significance,  the  other  predictors  are  only  marginally 
insignificant. 

The  application  of  the  EVAR  and  QUAD  threshold  models 
to  this  case  presented  results  which  had  not  been  previously 
encountered.   The  first-stage  VISCAT  I  versus  VISCAT  II+III 
separation  calculation  results  in  a  QUAD  threshold  value 
which  is  imaginary  and  an  unrealistic  EVAR  threshold  value 
of  209.588882.   These  thresholds  were  calculated  based  upon 
a  VISCAT  I  sample  size  of  85  observations  with  a  mean  of 
-1.012  and  standard  deviation  of  6.280  and  a  combined  VISCAT 
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II+III  sample  size  of  3096  observations  with  a  mean  of 
-1.864  and  standard  deviation  of  7.092.   These  results  are 
linked  to  the  preponderance  of  VISCAT  III  observations  in 
this  area  coupled  with  the  fact  that  these  employed  threshold 
models  are  designed  to  provide  for  a  minimum  error  when 
separating  samples.   These  results  indicate  that  a  forecast 
model  predicated  upon  the  dependent  data  set  employed  in  this 
case  would  strictly  forecast  VISCAT  III. 
2.   Area  4,    TAU-2  4 

Fig.  49  shows  the  relationship  of  equally  populous 
grouping  size  to  the  adjusted  AO  (dependent  data)  and  the 
adjusted  VISCAT  I  threat  score  (independent  data)  for  the 
PR  model.   This  case  required  three  iterations  of  the  four 
through  ten  grouping  size  calculations  before  any  non-zero 
dependent  AO  or  independent  VISCAT  I  threat  score  values  were 
achieved.   Additionally,  for  the  grouping  size  of  four,  no 
increase  in  AO  was  observed  at  the  second  predictor  level 
and  therefore  was  deleted  from  consideration.   A  grouping 
size  of  five  was  ultimately  selected  for  this  model. 

Figs.  50a  through  50c  represent  the  results  of  the 
three  Preisendorf er  strategies.  Generally,  the  independent 
VISCAT  I  threat  scores  yielded  for  these  schemes  are  poor 
with  the  highest  independent  adjusted  VISCAT  I  threat  score 
of  0.05  (unadjusted,  0.07)  being  achieved  by  the  MAXPROB  II 
strategy  at  the  fifth  predictor  level  followed  by  MAXPROB  I 
with  a  score  of  0.02  (unadjusted,  0.05)  and  natural  regression 
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with  0.01  (unadjusted,  0.04).   The  AO  scores  corresponding 
to  these  values  provide  for  a  slightly  different  scoring 
hierarchy.   The  highest  independent  adjusted  AO  score, 
namely  0.94%  (unadjusted,  85.64%),  is  attained  by  the 
MAXPROB  I  strategy  as  compared  to  scores  of  -30.05%  (unad- 
justed, 81.34%)  for  natural  regression  and  -37.56%  (unad- 
justed, 80.05%)  for  MAXPROB  II.   The  predictors  selected  for 
this  model  are  VRT9  25,  DTDP,  ENTR,  V8  50  and  DVRTDP . 

Fig.  51  shows  the  functional  dependence,  AO/Al  sta- 
tistics and  96%/05%  confidence  interval  values  for  this 
model.   For  this  case,  each  predictor  following  VRT925  proved 
to  be  significantly  functionally  dependent  on  its  predecessors 
and  therefore  only  a  single  predictor  forecast  array  is 
justifiable  for  this  model. 

Fig.  52  shows  the  relationship  of  equally  populous 
grouping  size  to  the  adjusted  AO  (dependent  data)  and  the 
adjusted  VISCAT  I  threat  score  (independent  data)  for  the 
PR+BMD  model.   As  in  the  previous  case,  three  iterations  of 
dependent  AO  and  independent  VISCAT  I  calculations  were 
required  before  any  non-zero  scores  were  achieved.   Addi- 
tionally, in  this  case,  the  grouping  sizes  of  four  and  five 
were  deleted  from  consideration  as  they  did  not  provide  an 
increase  of  AO  at  the  second  predictor  levels.   The  grouping 
size  ultimately  selected  for  this  model  was  nine. 

Figs.  53a  through  53c  show  the  results  of  the  three 
Preisendorf er  strategies  for  this  model.   The  scores  for 
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this  model,  as  in  the  previously  described  case,  are  quite 
poor  and  show  very  little  improvement  over  the  PR  model. 
The  highest  independent  adjusted  VISCAT  I  threat  score, 
namely  0.06  (unadjusted,  0.09),  was  achieved  by  the  MAXPROB 
II  strategy  followed  by  scores  of  0.05  (unadjusted,  0.07) 
for  the  MAXPROB  I  strategy  and  0.0  3  (unadjusted,  0.0  6)  for 
natural  regression.   The  corresponding  independent  adjusted 
AO  scores  show  a  maximum  score  of  -19.25%  (unadjusted, 
82.71%)  for  the  MAXPROB  I  strategy  followed  by  scores  of 
-30.05%  (unadjusted,  81.14%)  for  natural  regression  and 
-39.91%  (unadjusted,  79.71%)  for  the  MAXPROB  II  strategy. 

Fig.  54  shows  the  functional  dependence,  AO/Al  sta- 
tistics and  96%/05%  confidence  interval  values  for  this 
model.   For  this  case,  the  relative  magnitude  of  the  differ- 
ence between  the  actual  functional  dependence  and  its  9  6% 
confidence  interval  value  is  quite  small.   It  is  only  at  the 
second  predictor  level,  that  the  calculated  values  do  not 
exceed  the  corresponding  96%  confidence  interval  value. 

Fig.  55  shows  the  contingency  table  results  for  the 
EVAR  threshold  model.   The  QUAD  model  provided  an  imaginary 
threshold  value  at  the  second  regression  stage  and  therefore 
did  not  allow  completion  of  the  entire  separation  sequence. 
This  represents  the  only  occurrence  where  a  valid  equal 
variance  threshold  was  calculated  but  a  corresponding  quadratic 
threshold  proved  to  be  imaginary. 
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The  results  of  the  EVAR  model  were  in  keeping  with 
those  of  the  previously  described  PR  and  PR+BMD  models.   An 
independent  adjusted  VISCAT  I  threat  score  of  0.0  5  (unad- 
justed, 0.07),  was  achieved  with  a  corresponding  independent 
adjusted  AO  value  of  -13.15%  (unadjusted,  83.59%). 

The  first-stage  regression  separation  for  this  model 
was  based  upon  a  calculated  threshold  value  of  0.908275. 
Associated  with  this  threshold  were  449  VISCAT  I  observations 
with  a  mean  of  0.953  and  standard  deviation  of  0.030  and 
2489  VISCAT  II+III  observations  with  a  mean  of  0.976  and 
standard  deviation  of  0.027.   The  second-stage  VISCAT  II 
versus  VISCAT  III  separation  was  based  upon  a  calculated 
threshold  value  of  0.683569.   Associated  with  this  threshold 
is  a  VISCAT  II  sample  size  of  69  observations  with  a  mean  of 
0.831  and  standard  deviation  of  0.066  and  887  VISCAT  III 
observations  with  a  mean  of  0.912  and  standard  deviation  of 
0.078. 

For  the  QUAD  model,  an  initial  first-stage  threshold 
value  of  0.908275  was  successfully  calculated  with  the 
sample  statistics  addressed  above.   The  second-stage  regres- 
sion attempt  was  based  upon  a  VISCAT  II  sample  size  of  65 
observations  with  a  mean  of  0.829  and  standard  deviation  of 
0.067  and  VISCAT  III  sample  size  of  853  observations  with  a 
mean  of  0.905  and  standard  deviation  of  0.079.   These  sample 
statistics  produced  an  imaginary  threshold  value. 

In  general  Area  4,  TAU-24  is  characterized  by  very 
poor  independent  VISCAT  I  threat  scores.   This  indicates 
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that  there  is  very  little  skill  in  forecasting  visibility 
conditions  of  less  than  or  equal  to  2  kilometers  in  this 
area.   The  evaluated  models  show  little  variation  in  scores 
with  the  best  relative  model  for  this  area  and  forecast 
projection  being  the  PR+BMD  model  (Table  V) . 
3.   Area  4,  TAU-4  8 

Fig.  56  shows  the  relationship  of  equally  populous 
grouping  size  to  the  adjusted  AO  (dependent  data)  and  the 
adjusted  VISCAT  I  threat  score  (independent  data)  for  the  PR 
model.   As  in  the  TAU-00  and  TAU-24  forecast  projections  for 
this  area,  the  calculation  and  evaluation  of  dependent  AO 
and  independent  VISCAT  I  threat  scores  had  to  be  run  through 
three  iterations  before  any  non-zero  statistics  were  obtained. 
The  grouping  sizes  of  four  and  five  were  deleted  from  con- 
sideration because  the  addition  of  predictors  at  those  grouping 
sizes  did  not  provide  for  any  increase  in  AO  scores.   Based 
on  an  evaluation  of  the  results  as  shown  on  Fig.  56,  a  group- 
ing size  of  seven  was  selected. 

Figs.  57a  through  57c  show  the  results  of  the  three 
Preisendorf er  strategies  for  this  model.   In  general,  the 
near-zero  statistical  scores  encountered  in  the  grouping 
selection  process,  can  be  seen  through  the  third  predictor 
level,  along  with  a  noticeable  increase  in  scores  at  the 
fourth  and  fifth  predictor  level.   The  MAXPROB  I  strategy 
yields  the  highest  independent  adjusted  VISCAT  I  threat 
score,  namely  0.18  (unadjusted,  0.20),  for  this  model 
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followed  by  a  natural  regression  score  of  0.16  (unadjusted, 
0.19)  and  lastly  by  MAXPROB  II  with  a  score  of  0.13  (unad- 
justed, 0.16).   This  is  the  first  and  only  encountered  case 
where  the  natural  regression  strategy  effectively  achieved  a 
maximum  independent  VISCAT  I  threat  score  which  is  higher 
than  either  of  the  two  maximum  probability  strategies.   The 
independent  AO  scores  associated  with  these  peak  independent 
VISCAT  I  threat  scores,  adhere  to  this  same  scoring  sequence, 
with  MAXPROB  I  achieving  a  value  of  -14.94%  (unadjusted, 
81.86%)  followed  by  natural  regression  with  a  score  of 
-27.80%  (unadjusted,  79.83%)  and  MAXPROB  II  with  an  indepen- 
dent adjusted  AO  of  -43.98%  (unadjusted,  77.78%). 

Fig.  58  shows  the  functional  dependence,  AO/Al  sta- 
tistics and  96%/05%  confidence  interval  values  for  this  model. 
In  this  case,  only  the  third  predictor's  functional  dependence 
value  falls  below  the  associated  96%  confidence  interval 
value.   The  predictors  selected  for  this  model  are  VRT925, 
DVRTDP,  ENTR,  DUDP  and  RH. 

Fig.  59  shows  the  relationship  of  equally  populous 
grouping  size  to  the  adjusted  AO  (dependent  data)  and  the 
adjusted  VISCAT  I  threat  score  (independent  data)  for  the 
PR+BMD  model.   As  in  the  previous  area  4  cases,  three  com- 
plete iterations  of  the  four  through  ten  grouping  size  calcu- 
lations had  to  be  performed  before  any  non-zero  dependent 
AO  or  independent  VISCAT  I  values  were  achieved.   The 
grouping  size  ultimately  selected  for  this  model  was  nine. 
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Figs.  60a  through  60c  represent  the  results  of  the 
three  Preisendorfer  strategies.   A  unique  result  of  this 
model  is  that  for  the  first  time,  the  PR+BMD  model  did  not 
achieve  independent  VISCAT  I  threat  scores  which  exceed  those 
achieved  by  the  PR  model.   The  peak  independent  adjusted 
VISCAT  I  threat  score  of  0.17  (unadjusted,  0.20)  is  achieved 
by  the  MAXPROB  II  strategy  at  the  third  predictor  level. 
The  predictors  selected  for  this  model  are  BMDl,  DDVDP, 
DUDP,  ENTR  and  PRECIP. 

Fig.  61  shows  the  functional  dependence,  AO/Al  sta- 
tistics and  96%/05%  confidence  interval  values  for  this 
model.   Only  the  second  predictor  sufficiently  meets  the  9  6% 
confidence  interval  significance  criteria.   Based  upon  a 
strict  adherence  to  the  preselected  96%  confidence  interval 
significance  requirements,  these  functional  dependence 
values  provide  cause  for  uncertainty  in  the  representative- 
ness of  the  scores  achieved  after  the  second  predictor  level. 

Figs.  62  and  63  show  the  contingency  table  results 
for  the  EVAR  and  QUAD  threshold  models.   The  results  of  these 
models  are  very  similar  and  generally  quite  poor.   The  QUAD 
model  achieves  the  highest  relative  independent  adjusted 
VISCAT  I  threat  score  of  0.01  (unadjusted,  0.04)  as  compared 
to  a  score  of  -0.01  (unadjusted,  0.02)  for  the  EVAR  model. 
The  QUAD  model  similarly  achieves  the  highest  independent 
adjusted  AO  score  of  -2.07%  (unadjusted,  83.89%)  versus  a 
score  of  -7.88%  (unadjusted,  82.97%)  for  the  EVAR  model. 
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For  the  EVAR  model,  a  first-stage  regression  thres- 
hold value  of  0.847203  was  calculated  based  upon  a  VISCAT  I 
sample  size  of  109  observations  with  a  mean  of  0.918  and 
standard  deviation  of  0.052  and  2947  VISCAT  II+III  observa- 
tions with  a  mean  of  0.967  and  standard  deviation  of  0.037. 
The  second-stage  VISCAT  II  versus  VISCAT  III  separation  was 
based  upon  a  calculated  threshold  value  of  0.629338.  Asso- 
ciated with  this  threshold  is  495  VISCAT  II  observations  with 
mean  of  0.861  and  standard  deviation  of  0.103. 

For  the  QUAD  model,  a  first-stage  separation  thres- 
hold value  of  0.847203  was  calculated  upon  the  associated 
sample  statistics  addressed  above.   A  second-stage  threshold 
value  of  0.613739  was  calculated  based  upon  481  VISCAT  II 
observations  with  a  mean  of  0.770  and  standard  deviation  of 
0.089  and  2522  VISCAT  III  observations  with  a  mean  of  0.862 
and  standard  deviation  of  0.100. 

The  overall  results  associated  with  the  area  4,  TAU- 
48  case  are  particularly  unique.   The  independent  adjusted 
TAU-48  VISCAT  I  threat  score  represents  the  highest  area  4 
independent  VISCAT  I  threat  score  (by  a  minimum  of  0.09) 
achieved,  as  compared  to  TAU-0  0  or  TAU-24.   The  maximum 
independent  VISCAT  I  threat  score  is  achieved  by  the  PR 
model. 

Following  the  completion  of  the  testing  and  evaluation 
of  the  FATJUNE  19  83  data  set,  a  series  of  preliminary  experi- 
ments were  performed  with  the  May  15  to  June  23  1984  data 
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set  for  the  TAU-24  model  forecast  projection.   These  experi- 
ments consisted  of  evaluating  the  TAU-24,  1983  forecast 
arrays  and  equations  (generated  with  FATJUNE  19  83  data) 
with  training  and  testing  cases  of  TAU-24,  1984  data.   In 
performing  this  evaluation,  the  1984  data  set  was  divided 
into  "dependent"  and  "independent"  portions.   This  data 
separation  is  a  function  of  the  specific  mechanics  of  the 
computer  programs  utilized  in  this  study  and  is  not  associated 
with  the  generation  of  additional  forecast  arrays  or  equations 
Two  homogeneous  areas  were  evaluated,  namely  area  2  and  area 
3W.   This  essentially  provided  an  independent  verification 
of  the  utility  of  the  1983  forecast  arrays  and  equations  in 
predicting  observed  1984  visibility  in  these  areas. 

In  general,  the  skill  and  contingency  table  results 
for  these  experiments  compare  very  favorably  to  those  achieved 
with  the  FATJUNE  19  83  data.   A  summary  of  the  results  of 
each  of  the  evaluated  models  is  provided  in  Table  VII.   For 
area  2,  a  peak  independent  adjusted  VISCAT  I  threat  score 
(1984  data),  namely  0.27  (0.33  unadjusted),  was  achieved 
with  each  of  the  two  threshold  models .   This  compares  to  a 
peak  independent  adjusted  VISCAT  I  threat  score  (1983  data) 
of  0.29  (0.34  unadjusted)  achieved  by  the  same  two  models. 
For  area  3W,  a  peak  independent  adjusted  threat  score  (1984 
data)  of  0.28  (unadjusted,  0.42)  similarly  compares  to  a 
peak  independent  adjusted  threat  score  (1983)  of  0.13 
(unadjusted,  0.36). 
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The  overall  results  of  the  1984  data  experiments  can 
be  seen  in  Table  VII  and  are  represented  by  Fig.  64  which 
illustrates  the  results  of  the  PR+BMD  model,  MAXPROB  II 
strategy,  for  area  2,  TAU-24. 

A  review  of  the  results  associated  with  area  4  for 
TAU-00,  TAU-24  and  TAU-48  indicates  that  none  of  the  models 
evaluated  achieved  very  encouraging  skill  and  threat  scores. 
Consequently,  the  maximum-likelihood-of -detection  criteria 
(MLDC)  was  proposed  as  an  alternative  technique  to  increase 
threat  scores  in  area  4. 

A  series  of  experiments  involving  an  arbitrarily 
selected  population  of  two  hundred  normally  distributed 
events,  partitioned  into  eight  separate  threat/non- threat 
samples,  were  performed  to  demonstrate  the  theoretical  utility 
of  the  MLDC  at  low  threat  frequencies.   Threshold  values 
were  calculated,  for  various  threat  frequencies,  using  the 
EVAR  minimum  probable  error  and  MLDC  techniques  and  two  by 
two  contingency  tables  were  constructed  to  tabulate  the  asso- 
ciated threat  score,  percent  correct  and  false  alarm  rate 
results.   Fig.  65  shows  the  resulting  plot  of  threat  score 
versus  threat  frequency  which  illustrates  the  amount  of  in- 
crease in  threat  score  associated  with  the  MLDC  model.   Asso- 
ciated with  these  higher  threat  scores  are  correspondingly 
higher  "costs,"  namely  higher  false  alarm  rates,  illustrated 
in  Fig.  66,  and  lower  percent  correct  scores,  illustrated  in 
Fig.  67. 
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A  set  of  two  experiments  was  performed,  utilizing 
FATJUNE  1983,  TAU-24  data  and  the  two-stage  separation 
scheme  outlined  in  Chapter  IV  (MLDC  model) ,  to  evaluate  the 
relative  performance  of  the  MLDC  and  EVAR  models  on  area  4. 
In  general,  the  results  of  these  two  experiments  were  consis- 
tent with  the  results  predicted  by  the  aforementioned 
theoretical  experiments.   The  most  obvious  area  of  agreement 
is  the  significantly  lower  independent  adjusted  VISCAT  I 
and  VISCAT  II  threat  scores  (both  are  considered  threatening 
events  in  this  study),  namely  0.01  (unadjusted,  0.04)  and 
-0.14  (unadjusted,  0.00),  achieved  by  the  EVAR  model.  Fig. 
68,  as  compared  to  the  corresponding  scores  of  0.04  (unad- 
justed, 0.07)  and  0.03  (unadjusted,  0.15)  achieved  by  the 
MLDC  model.  Fig.  69. 
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VI.   CONCLUSIONS  AND  RECOMMENDATIONS 

A.   CONCLUSIONS 

The  primary  objective  of  this  study  was  to  expand  upon 
the  initial  research  and  experimentation  presented  by  Karl 
(1984)  and  to  propose  a  viable  statistical  forecasting  scheme 
suitable  for  eventual  employment  in  an  operational  U.S.  Navy 
marine  visibility  MOS  forecasting  system.   In  general, 
while  the  results  of  linear  regression  and  the  evaluated 
Preisendorf er  models  are  roughly  comparable,  it  has  been 
shown  that  two  specific  statistical  approaches,  namely  the 
PR+BMD  model's  MAXPROB  II  strategy  and  the  linear  regression 
models,  yield  the  best  results  (as  measured  by  independent 
VISCAT  I  threat  score)  achieved  in  this  study.   The  PR+BMD 
model  achieved  the  best  results  for  six  of  the  eight  evaluated 
cases:   area  2,  TAU-48;  area  3W,  TAU-24  and  TAU-48;  and  area 
4,  TAU-00,  TAU-24  and  TAU-48.   The  nearly  identical  results 
of  both  the  equal  variance  and  quadratic  linear  regression 
threshold  models  provided  the  best  skill  and  threat  scores 
for  area  2,  TAU-00  and  TAU-24.   A  common  characteristic  of 
each  of  the  evaluated  cases  is  that  the  predictability  of 
visibility  category  II  is  relatively  very  poor  and  nearly 
always  poorer  than  that  for  visibility  categories  I  or  III. 
This  pattern  affirms  the  findings  of  similar  Pacific  Ocean 
visibility  studies  [Renard  and  Thompson,  1984]  as  well  as 
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t±iose  documented  by  Karl  (19  84)  and  further  supports  Karl's 
recommendation  to  change  from  a  three-category  to  a  two- 
category  visibility  forecasting  scheme. 

An  evaluation  of  the  overall  results  of  this  study  shows 
that  no  real  connection  between  individual  model/strategy 
and  either  the  homogeneous  oceanic  area  (2,  3W  and  4)  or 
model  output  time  (TAU-00,  TAU-24  and  TAU-48)  can  be  made. 
The  linear  regression  threshold  models  performed  best  for 
area  2,  the  intermediate  poor  visibility  oceanic  area,  while 
the  Preisendorf er  methodology  incorporating  linear  regression 
equation  predictors  proved  the  best  in  the  evaluated  homogene- 
ous areas  with  the  greatest  and  lowest  relative  concentration 
of  poor  visibility  observations.   The  trend  of  visibility 
category  I  skill  and  threat  scores,  for  each  homogeneous  area 
and  model  output  time,  seems  to  contradict  the  preliminary 
supposition  that  peak  skill  scores  would  be  associated  with 
the  area  containing  the  greatest  frequency  of  poor  visiblity 
observations  and  the  TAU-00  model  output  time.   This  result 
is  most  apparent  with  area  4,  where  threat  scores  increase 
with  increasing  model  forecast  projections  until  they  achieve 
values  at  TAU-48,  which  are  nearly  identical  to  those  for  the 
other  two  homogeneous  areas.   This  type  of  trend  in  skill 
and  threat  scores  most  likely  reflects  the  overall  strength 
of  the  statistical  relationships  for  the  predictand/predictors 
involved  irrespective  of  the  frequency  of  specific  visibility 
observations . 
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In  several  cases,  the  maximum  independent  visiblity 
category  I  threat  score  achieved  by  the  PR+BMD  model  was 
reached  at  the  first  predictor  level.   In  several  additional 
cases,  threat  score  values  which  were  only  marginally  lower 
than  peak  value,  were  similarly  achieved  at  the  first  pre- 
dictor level.   Forecasting  arrays  involving  only  one  predic- 
tor drastically  reduce  required  computer  storage  and 
consequently  such  arrays  are  a  desirable  attribute  to  any 
operational  MOS  forecasting  system.   A  MOS-type  forecasting 
system  predicated upon  such  a  small  number  of  predictors 
would  prove  extremely  beneficial  in  an  independent  single 
station  forecasting  scenario  such  as  that  experienced  by  an 
aircraft  carrier  based  U.S.  Navy  Oceanography  Officer. 

The  concept  and  practical  employment  of  functional 
dependence,  associated  with  the  Preisendorf er  methodology, 
provides  a  greater  restriction  on  the  statistical  significance 
of  the  skill  and  threat  score  results  achieved  in  this  study, 
as  compared  to  that  which  was  previously  experienced  by 
Karl  (19  84).   It  was  shown  that  the  calculated  functional 
dependence  values  for  each  respective  predictor  or  group  of 
predictors  often  exceeded  the  associated  96%  confidence 
interval  value  at  the  first  or  second  predictor  level  and 
rarely  met  the  requirements  for  significance  for  an  entire 
array  of  selected  predictors.   This  restriction  further 
indicates  that  any  operational  forecasting  scheme  should 
most  likely  be  composed  of  only  a  minimal  number  of  select 
predictors . 
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The  difference  between  the  equal  variance  and  quadratic 
threshold  models  was  shown  to  be  very  minimal.   The  two-stage 
visibility  category  separation  approach  is  designed  to 
handle  cases  with  distinct  separability  between  categories 
while  providing  for  minimal  error  in  the  calculated  threshold 
values.   This  condition  was  not  met  in  the  area  4,  TAU-00 
and  TAU-24  cases  and  subsequently  lead  to  unrealistic  thres- 
hold values. 

The  preliminary  independent  evaluation  of  the  15  May  to 
23  June  1984  data  set  provided  a  crucial  test  and  verifica- 
tion of  the  utility  of  the  forecast  arrays  and  equations 
presented  in  this  study. 

The  introduction  and  initial  evaluation  of  the  maximum- 
likelihood-of-detection  threshold  model  offers  another 
technique  to  the  pool  of  visibility  prediction  schemes. 
This  method  appears  to  be  most  beneficial  in  areas  of  low 
threat  frequency. 

B.   RECOMMENDATIONS 

The  following  recommendations  are  offered  to  future 
researchers : 

1.  Remove  the  MAXPROB  I  and  natural  regression  strategies 
of  the  Preisendorf er  methodology  from  further  consideration 

in  the  forecasting  of  marine  horizontal  visibility. 

2.  Delete  one  of  the  two  threshold  models  evaluated 
in  this  study,  and  investigate  additional  thresholding 
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techniques  based  on  the  Beta  distribution  and  the  maximum- 
likelihood-of-detection  criteria . 

3.  Revise  the  current  three-category  visibility  scheme 
to  a  two-category  scheme  where  visibility  categories  I  and 
II  are  combined.   This  should  be  particularly  beneficial  in 
those  homogeneous  areas  with  extremely  low  frequencies  of 
visibility  category  I  and  II  observations. 

4.  Expand  the  initial  set  of  potential  predictors  to 
include  air-sea  temperature  differences  as  well  as  additional 
derived  predictors  such  as  the  advections  and  gradients  of 
temperature,  vorticity  and  moisture  in  order  to  more  fully 
simulate  the  physical  processes  associated  with  poor  marine 
visibility.   Additionally,  include  TAU-00  and  TAU-24  model 
output  parameter  fields  as  potential  predictors  in  future 
evaluations  of  TAU-24  and  TAU-48  MOS  forecasts. 

5.  Evaluate  OOOOGMT  data  sets  to  determine  the  effect 
of  nighttime  conditions  on  both  visibility  observations  and 
NOGAPS  model  output  parameters. 

6.  Investigate  new  procedures  to  determine  the  number 
of  equally  populous  predictor  intervals.   The  following 
procedure  [Preisendorf er ,  1984]  is  proposed: 

a.   To  establish  the  number  of  equally  populous  predic- 
tor intervals  for  any  predictor,  consider  a  bivariate 
predictand/predictor  [Preisendorf er ,  1983a].   Start  with 
m  =  1  and  find  the  potential  predictability  (PP)  for  the 
resultant  plot,  call  it  "PP(1)."   In  general,  PP(m)  is  the 
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PP  for  the  general  case  of  m.   Successively,  find  PP(m) 
for  m  =  1,2,...,  and  continue  to  subidivde  the  predictor 
range  as  long  as  PP  increases:   PP(m)  <  PP(m+l).   Stop  at 
PP(m)  if  PP(m+l)  £  PP(m)  or  if  PP(m+l)  <  PP(m+ll96),  where 
the  later  is  defined  by  Preisendorf er  (1983a)  and  denoted 
by  "PP(96)."  This  last  condition  avoids  sparse  bivariate  data 
plots,  caused  by  too  large  an  m.   It  was  Karl's  1984  experi- 
ence that  five  to  eight  equally  populous  predictor  intervals 
are  sufficient  for  all  predictors.   Hence  m,  for  each  pre- 
dictor, is  expected  to  be  in  this  neighborhood. 

b.  Order  the  set  of  available  predictors  in  descending 
value  of  potential  predictability  (PP) .   Break  ties  with 

AO  (PP  and  AO  are  defined  by  Preisendorf er  (1983a)).   AO 
is  the  actual  skill,  after  the  prediction  has  been  made. 

c.  The  first  predictor  is  that  with  the  greatest 

PP.   Compute  associated  AO  and  Al.   Call  them  AO ^    and  Al ^   . 

7.   Associated  with  recommendation  6.  above,  improve 
the  predictor  selection  procedure  as  follows : 

a.   Suppose  k-1  predictors  have  been  chosen,  let 
them  be  X, ,...,X,_,.   Let  Y  be  a  new  predictor  candidate. 
Admit  Y  as  the  kth  predictor  if  the  three  following  conditions 
are  satisfied: 

(1)   Functional  dependence  (YJX.)  <  functional 
dependence   (y|x.;05)  for  i  =  l,...,k-l 
(i.e.,  the  functional  dependence  of  X. 
and  Y  is  not  significantly  large  for  each 
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i  =  l,...,k-l.  Find  functional  dependence 
(yIx.)  and  functional  dependence  (y|x.;05) 
as  described  by  Preisendorf er  (1983c)). 

(2)  AO^^)  >  A0(^-^)  and  Al^^^^  >  Al^^'^^ 

(3)  AO^^^  >  A0(96)  and  Al^^^  >  Al(05) 

All  three  conditions  must  hold  for  admittance  of  Y  to  the 
predictor  set. 

b.  A  less  stringent  predictor  selection  process 
would  be  to  form  functional  dependence  (Y.lx.)/  where  X., 
i  =  l,...,k-l  are  the  selected  predictors,  and  the  Y., 

j  =  l,...,q  are  the  as-yet  unselected  predictors.   Here 

(k-l)+q  =  p,  the  original  number  of  potential  predictors. 

Next,  form  |min|max  functional  dependence  (Y. |x.) | ].   This 
J    i -"   ^ 

fixes  that  Y.  for  which  functional  dependence  (Y. Ix.)  is 
the  least  possible  of  the  maximum  functional  dependence 
values  over  the  present  X  set.   This  makes  the  best  out  of 
the  worst  case  of  functional  dependence  (i.e.,  select  the 
Y.  farthest  from  the  set  of  X.). 

c.  Continue  to  repeat  step  7a.  above  until  all 
potential  predictors  are  used  up  (the  critical  values  of 
A0(96)  and  Al(05)  are  as  defined  by  Preisendorf er  (1983b). 
Another  reason  for  stopping  may  be  that  allotted  CPU  time  is 
used  up  before  the  predictors. 

8.   Investigate  a  further  and  more  complete  verification 
of  the  forecast  arrays  and  equations  presented  in  this  study 
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utilizing  available  1984  data  sets.   Specifically,  utilize 
the  1984  data  set  as  an  entire  independent  test  case  without 
first  removing  a  portion  of  the  data  for  use  as  a  dependent 
forecast  array /equation  training  set.   Additionally,  gener- 
ate an  additional  set  of  forecast  arrays  and  equations 
based  on  combined  1983  and  1984  FATJUNE  data  and  evaluate 
the  statistical  stability  of  the  equations  as  different 
years  of  data  are  merged  into  a  larger  data  base. 
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APPENDIX  A 
LINEAR  REGRESSION  AND  THRESHOLD  MODELS 

A.   LINEAR  REGRESSION 

The  linear  regression  techniques  used  in  this  study 
expand  upon  and  slightly  modify  those  first  presented  by 
Karl  (1984).   In  this  study,  two  separate  least-squares, 
multiple  linear  regression  software  programs;  referred  to 
as  the  BMDP2R — Stepwise  Regression  and  BMDP9R — All  Possible 
Subsets  Regression  computer  programs  in  the  BMDP  Statistical 
Software  [University  of  California,  1983],  were  used. 

The  independent  variable  selection  procedure  employed  in 
the  BMDP2R  program  is  referred  to  as  a  forward,  step-wise 
selection  process  where  predictors  are  selected  from  a  large 
group  of  available  potential  independent  variables  based 
upon  the  highest  correlation  with  the  dependent  predictand 
(visibility  in  this  study) .   This  correlation  is  calculated 
based  upon  certain  F-to-enter  and  F-to-remove  limits,  where 
F  is  a  ratio  which  tests  the  significance  of  the  coefficients 
of  the  predictors  in  the  regression  equation. 

The  regression  model  fitted  to  the  data  is 


y   =   a  +  b,x,  +  b„x„  +  . . .  +  b  x   +  e 
^  112  2  n  n 


where : 
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y   =   the  dependent  variable  (predictand)  which 
can  be  either  a  continuous  function  or  a 
discrete  value 

X, / . . . ,x    =   the  independent  variables  (predictors) 

b, , . . . ,b    =   the  regression  coefficients 
In  ^ 

a   =   the  intercept 

p   =   the  number  of  independent  variables 

£   =   the  error  with  mean  zero 

The  predicted  value  y,  and  the  general  form  of  the  resulting 
equation,  is 


y   =   a  +  b,x,  +  b_x^  +  ...  +  b  x 
-^  112  2  n  n 


The  step-wise  selection  of  predictors  continues  until  there 
are  no  predictors  remaining  which  meet  the  requisite  F-to- 
enter  criteria.   The  regression  equation  generated  by  the 
BMDP2R  program  is  outputted  at  each  regression  step  where 
variables  are  selected  as  independent  predictors,  along  with 

its  corresponding  R  value  (the  correlation  of  dependent 

2 
variable  y  with  the  predicted  value  y)  and  R   value.   The 

resulting  equation  sets  are  reviewed,  and  that  equation  con- 

2 

taining  only  those  predictors  which  increased  R   by  at  least 

0.01  are  retained  for  application. 

The  procedure  employed  with  the  BMDP9R  program  varies 
from  that  of  the  BMDP2R,  in  that  a  "best"  possible  subset, 
derived  independently  of  variable  or  variable  sequence,  is 
calculated  from  the  group  of  potential  predictors.   Once  this 
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"best"  subset  is  identified,  a  linear  regression  equation  is 
fitted  to  the  data,  based  only  upon  those  selected  predic- 
tors, in  a  fashion  identical  to  that  for  the  BMDP2R  program. 
The  "best"  possible  subset  is  calculated  by  a  Furnville- 
Wilson  algorithm  which  provides  the  user  with  a  variety  of 
subordinate  subsets  in  addition  to  the  "best"  subset.   Three 
criteria  are  available  to  define  the  "best"  possible  subset 

as  a  function  of  independent  variables  (predictors)  and  a 

2 
dependent  variable  (predictand) :   the  sample  R  ,  the  adjusted 

2 

R  and  Mallow's  Cp .   For  this  study,  the  Mallow's  Cp  criteria 

is  defined  as: 

Cp   =   RSS/S  -  (N  -  2P' ) 

where: 

RSS   =   the  residual  sum  of  the  squares  for  the 
new  subset  being  tested 

S   =   the  residual  mean  square  based  on  the 

linear  regression  using  all  independent 
variables 

P'   =   the  number  of  variables  in  each  subset 

N   =   the  total  number  of  cases 

For  this  method,  "best"  is  defined  as  the  smallest  Cp  value. 

Independent  variable  selection  for  the  BMDP9R  program 
begins  with  a  general  screening  of  the  entire  set  of  potential 
predictors.   Variables  which  are  identified  as  redundant. 
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linear  combinations  of  other  variables,  with  respect  to  the 
predictand,  in  this  general  screening  are  deleted  from  further 
consideration.   The  t  statistics  for  the  coefficients  which 
minimize  the  Cp  value  for  each  reviewed  subset  identifies 
the  "best"  subset.   The  number  of  predictors  assigned  to  each 
subset  can  be  predefined  and  for  this  study  each  subset 
equation  was  required  to  have  six  predictors. 

The  role  of  regression,  once  appropriate  predictor  varia- 
bles have  been  selected,  is  simply  that  of  dimension  reduction 
(representing  a  multivariate  structure  by  a  univariate 
proxy  which  constitutes  a  classif icatory  or  predictive 
index).   This  proxy  takes  the  form  of  a  polynomial,  linear 
in  its  coefficients,  of  the  components  of  the  multivariate 
structure.   The  problem  now  becomes  one  of  determining  the 
form  of  the  state  conditional  distributions  (one  for  each 
group  of  interest;  e.g.,  one,  two  and  three  for  visibility 
categories  I,  II  and  III,  as  used  in  this  study) .   Once  an 
appropriate  form  has  been  selected,  it  remains,  then,  to 
determine  the  parameters  of  the  class  conditional  distribu- 
tions (e.g.,  means  and  variances)  and  then  apply  an  appro- 
priate decision  criterion  or  threshold  model. 

B.   THRESHOLDS  [Lowe,  19  84a] 

1 .   Notation 

E  =  an  event;  this  is  an  indicator  variable  which 
when  E  =  1,  the  threatening  event  occurs,  and 
when  E  =  0,  the  non- threatening  event  occurs. 
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C   =   the  classification  of  an  unknown  event  which 
when  C  =  1,  the  event  is  classified  as  a 
threat,  and  when  C  =  0,  the  event  is  classi- 
fied as  a  non-threat. 

P[E=1]   E   unconditional  probability  of  occurrence  of 
threat . 

P[E=0]   E   unconditional  probability  of  occurrence  of 
non- threat . 

Error  of  the  1st  kind  (false  alarm)   [C=lnE=0]. 

Error  of  the  2nd  kind  (miss)   [C  =  0  n  E  = 1]  . 

P[C=lnE=0]   =   joint  probability  of  an  error  of  the  1st 
kind . 

P[C=OnE=l]   E   joint  probability  of  an  error  of  the 
2nd  kind. 

P[C=1|e=0]   =   class  conditional  probability  of  misclassi- 
fying  a  non-threat. 

P[C=0|E=1]   e   class  conditional  probability  of  misclassi- 
fying  a  threat.. 

P[C=lnE=0]       =      P[C=1Ie=0]     P[E=0]. 

P[C=OnE=l]       =       P[C=0|E=1]     P[E=0]. 

z   =   a  value  of  the  predictive  index  (equivalent 
to  y ,  above) . 

Z   =   range  of  the  predictive  index  on  the  real  line 


For  a  dichotomous  problem,  Z  is  into  two  parts  Z  ,  Z  , 


C   =   0   if   z  t  Z 


1   if   z  e  Z 


The  decision  regions  are  mutually  exclusive  and  exhaustive 
(i.e.,  Z   nZ   =0  and  Z  =  Z   uZ.,). 
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Thresholds   =   boundary (s)  between  decision  regions. 

P(z|e=0)    e   class  conditional  density  of  z  given 

that  E  =  0. 

p(z|E=l)    =   class  conditional  density  of  z  given 

that  E  =  1. 

A(z)       =      p(z|e=1)/p(z|e=0)       =      the   maximum    likelihood 

ratio    (i.e.,    the    ratio   of    class    conditional 
densities) . 

p         =      p{[C=lnE=0]     u     [C=OnE=l]}       =      the    total 

probability  of  error. 


2 .   Minimum  Probability  of  Error  Criterion 

p    =   probability  of  an  incorrect  classification. 


p    =   p[C=l|E=0]  p[E=0]  +  p[C=0|E=l]  p[E=l] 


where  p[E=l]  +  p[E=0]  =  1.   NOte  that  the  events  E  =  1 
and  E  =  0  are  mutually  exclusive  and  exhaustive.   The  objec- 
tive is  to  select  decision  regions  (thresholds)  so  as  to 

minimize  p  . 
^e 

p[C=0|E=l]       =         /         p(z|E=l)dz      =      the   probability   of 

ZeZQ 

misclassif ying   E   =    1. 

p[C=OlE=l]       =         /         p(z|E=l)dz    +      /         p(z|E=l)dz 

ZeZ_^  ZeZ, 

-       /         p(z |E  = l)dz 


p[C=0|E=l]       =      1    -      /         p(z|E=l)dz  these    are 

zeZ,  substituted 

into    the 
expression 
p(C=llE=0]       =         /         p(z|E=0)dz  for    p 

ZeZ,  ^ 
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then, 


p    =   p[E=0]   /    p(z|E=0)dz  +  p[E=l)[l  -   /    p(z|E=l)dz] 
^  ZeZ  Z£Z 


and  algebraic  rearrangement  yields. 


p    =   p[E  =1]  -   /    {p[E=0]  p(z|E=0)  -  p[E=l)  p(z|E=l)  dz} 
®  ZeZj^ 

In  order  to  minimize  p  ,  Z,  (the  decision  region  for  C  =  1) 

el 

will  include  all  those  values  of  z  for  which  the  integrand 
in  the  expression  for  p   will  be  negative.   The  decision 
regions  can  be  symbolically  represented  as  follows: 


Zq   =   {z:  p[E=0]  p(z|E=0)  -  p[E=l]  p(z|E=l)  >  0} 

Z,   =   {z:  p[E=0]  p(z|E=0)  -  p[E=l]  p(z|E=l)  <  0} 

An  alternative  representation  is  given  by, 

Zq   =   {z:  p[E=0]  p(z|E=0)  >  p[E=l]  p(z|E=l)} 
=   (z:  p[E  =  0]/p[E  =  1]  >  p(z|E  =  l)/p(z|E  =0)  } 

Likewise , 

Z^      =       {z:    p[E  = 0]/p[E  = 1]     <    p(z |E  = l)/p(z|E  = 0) } 
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These  statements  can  be  combined  to  give, 

c=l 
p(z|E  =l)/p(z|E  =0)   =   A(z)   ^   p[E  =0]/p[E  =1] 

c=0 

Thresholds    are    the   value (s)    of    z    for  which 

A(z)       =      p[E  =0]/p[E  =1] 

This  equation  can  be  solved  for  z  either  analytically  or 

numerically  depending  on  the  forms  of  the  density  functions 

3 .   Threshold  Cases 

In  order  to  examplify  the  model,  the  assumption  is 

made  that  the  class  conditional  distributions  are  Gaussian. 

There  are  essentially  three  distinct  cases  that  can  arise. 

a.   Case  I:   Equal  variances;  different  means 

(Referred  to  as  the  equal  variance  model  (EVAR) 
in  the  text) 


p(z|E=l)   =   k  exp{  (-1/2)  (z  -y^)^/a^} 


p(z|E=0)   =   k  exp{(-l/2)  (z  -Uq)^/o^} 


where: 


,„  ^-1/2  -1 
k   =   (2it)  '    a 


2      2  c=l 

exp{  (-1/2)  (z  -y,  )  /a  }  p^ 

A(z)   =   ^ J-  -^ 

exp{(-l/2)  (z  -Mq)  Va"^}  ^^q   ^1 
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where  A  is  the  likelihood  ratio  and  p   =  p[E  =0]  and 
p   =  p[E  =1] .   Thus,  the  threshold  value  is 


;*   =   (yQ+u^)/2  +  o  In  {p^/p^}  /  {^-^  -  \1q) 


Classification  index  (z) 

The  position  of  the  threshold  depends  on  the  relative  values 
of  p,  and  p^ .   The  threshold  moves  toward  the  group  with  the 
smallest  p..   If  p,  =  p-  the  threshold  will  be  the  value  of 
z  where  the  densities  intersect  (i.e.,  where  the  densities 
are  equal) . 

b.   Case  II:   Equal  means;  different  variances 


A(z) 


2   2    c=l 
a^expi  {-1/2)  {z  -  u^)    /o^}    ^    p 


0 


o^exp{{-l/2)  {z  -Uq)    /o^}      ^^Q   ^1 


with  the  threshold 


Z*   =  ± 


0    2  2 

.  2   2. 
(o^-Qq) 


In 


Pl^O 


n  1/2 
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Note  that  in  this  situation  there  are  two  thresholds.  The 
group  having  the  smaller  variance  will  lie  between  the  two 
thresholds . 


E=  1 


Classification  index  (z) 

The  thresholds  shown  are  typical  of  a  situation  where  p-,  <  p 

Note  that  these  thresholds  lie  between  the  two  intersections 

of  the  densities.   If  the  inequality  of  prior  probabilities 

were  reversed,  the  thresholds  would  lie  outside  of  the 

region  between  the  two  density  intersections.   Further  note 

that  the  decision  region  for  the  group  having  the  lesser 

variance  lies  between  the  thresholds. 

c.   Case  III:   General  Solution  (Referred  to  as  the 
Quadratic  Model  (QUAD)  in  the  text) 


0 


p(z|E=l)   =   k/o^  exp{ (-1/2) (z  - p^)^/o^} 


p(z|E=0)   =   k/o^  exp{(-l/2)  (z  -  p  )^/a^} 


0 
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z  -  y 


0x2 


z  -  y 


A(z)   =   exp{l/2  I  (— ^)'-  -  ( 

•^0 


i)2 


c=l 
c=0 


-1/2 
where  k  =  (27t)     .   Algebraic  manipulation  produces 


2    2   2       2      2 


2  2    2  2       2  2 

+  [  (o-^Pq  -  a^y^)  -  20^0-^  In  (PqO^/p-^Oq)  ] 


c=l 

> 

< 
c=0 


which  is  recognizable  as  a  quadratic  equation  in  z 


where 


2        1/2 
z*   =   -b  ±  (b   -  4ac)  /^/2a 


a   = 


2     2 

^1  -  ^0 


b   =   2(aQy^  -  al^Q 


2  2     2  2       2  2 

c  =  (0;l^o  ~  ^o'^i^  ~  ^^1^0  "^^  ^Pq'^i^Pi^o 
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_ 

r,  ^=' 

r\  ^' 

>> 

c 
o 
Q 

E  =  0       1 

\  \ 

"^                                              ^^ ^2 , 

Classification  index  (z) 

The  remarks  given  for  the  figures  in  cases  I  and  II  are  also 
applicable  here.   More  often  than  not,  only  one  of  a  pair  of 
thresholds  induced  by  differing  variances  will  be  of  real 
interest.   If  the  variances  of  the  two  groups  are  radically 
different,  then  both  members  of  the  threshold  pair  become 
important. 

4 .   Th e-Maximum- Like lihood-of -Detect ion  Criteria 

For  this  specific  model  the  following  background  is 

provided : 

event  space:   2'  mutually  exclusive  populations 

7T-,  7T,  forecast  decision  space:   2  possible  forecasts 

^0'  ^1 

d„  is  a  correct  forecast  if  tt   actually  occurs 
d-j  is  a  correct  forecast  if  tt.,  actually  occurs 

Problem:   select  the  decision  rule  d(z)  which  maps 
the  observation  space  Z  into  some  forecast  space 
in  some  optimal  manner. 
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Z  may  be  an  observed  variable  or  it  may  be  an 
univariate  index  derived  from  a  number  of  variables. 

For  this  two  decision  problem,  Z  is  partitioned 
into  two  parts,  Z^  and  Z, . 

d(z)   =   d^   if   z  e  Zq 
d(z)   =   d,   if   z  fc  Z, 

where  Z^  n  Z,  =  0  and  Z^  u  Z^  =  Z 
0     1  0     1 

The  maximum-likelihood-of-detection  criteria  repre- 
sents the  simplest  decision  model.   The  basic  involves 
selecting  the  forecast  (decision)  corresponding  to  the  obser- 
vation (signal)  which  is  the  most  likely  symptom  of  the  event 
subsequently  observed.   Consider  the  following  example: 

problem:   diagnose  disease  A  or  disease  B. 

The  observed  symptoms  occur  with  probability  0.75 
for  A  and  0.1  for  B.   By  the  maximum-likelihood-of-detection 
criteria  (MLDC) ,  diagnose  disease  A  because  A  is  the  most 
likely  cause  of  the  observed  symptoms  (if  there  is  no  more 
information) .   But  if  we  know  that  A  is  rare  and  B  is  common, 
the  above  decision  may  not  be  optimal  and  MLDC  may  not  be 
appropriate.   MLDC  requires  only  that  we  know  the  event 
conditional  probability  density  functions  of  the  observations. 
That  is: 
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p(z  I  tTq)  and  p  (  z  |  tt  ,  ) 


decision  rule:   d(z) 


d^  if  p(z|7T^)  >  pCzItIq) 
d^  if  p(z|tt^)  <  p(z|7Tq) 


In  the  following  development  the  Gaussian  density 
is  used  to  exemplify  the  model. 


-o    ""  z 

P(z|tt    )       =      l//2^  exp{-l/2( ^)  ^  } 


0 


z  -  z 


1.  2 


P(z|tt^)       =      l//27TOj_    exp{-l/2( -)  ^  ] 


P(Z  I  7T      ) 

definition:   likelihood  ratio  A(z)  =       ^ 


P(zhQ) 


for  convention  sake  we  assume  z,  >  z  , 


2.2 

^1  >  ^0 
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2  ^   2 

^1  '  ^0 


*  note  the  class  having  the  largest  variance  has  a 
bifurcated  decision  region. 

In  the  case  where  the  variances  are  equal,  the 
situation  simplifies  considerably. 


2  —   —      2—2—2 

2o  (2^  -  Zq)  -  a  (Zj_  -  z  )  >    0 


0 


2z   ^    (^1+^0^ 


<     2 


z 
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^0  =      °1 


^0  "-  /^i 

It  is  obvious  that  z*  is  simply  the  average  of  the 
means  of  the  class-conditional  distributions  and  is  found 
at  the  intersections  of  the  two  density  curves. 

In  the  foregoing,  normal  class  conditional  distribu- 
tions were  assumed.   This  was  done  because  the  Gaussian  form 
admits  of  a  rather  clean  analytical  solution.   However,  the 
general  concept  of  the  minimum  probable  error  decision 
criteria  may  be  applied  to  any  form  of  density  function. 
Indeed,  the  density  function  of  one  group  need  not  even  be 
the  same  form  as  that  for  another  group  (one  might  be  exponen- 
tial and  the  other  Gaussian) .   The  difficulty  with  most  non- 
Gaussian  forms  is  that  they  seldom  admit  of  closed  analytical 
forms  and  require  numerical  means  in  determination  of 
thresholds . 
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APPENDIX  B 

NQGAPS  PREDICTOR  PARAMETERS  AVAILABLE  FOR 
NORTH  ATLANTIC  OCEAN  EXPERIMENTS 

I.   Area:   Entire  North  Atlantic  Ocean  and  Mediterranean  Sea 

Model  output  time:   1200GMT  (TAU-0  0) 

15  May — 7  July  1983 

A.   Model  output    Descriptive  name  of  parameter 
parameter 

DIOOO  1000  mb  geopotential  height 

D925  925  mb  geopotential  height 

D850  850  mb  geopotential  height 

D700  *  700  mb  geopotential  height 

D500  500  mb  geopotential  height 

D400  *  400  mb  geopotential  height 

D300  *      *    300  mb  geopotential  height 

D250  *  250  mb  geopotential  height 

TAIR  Surface  air  temperature 

TIOOO  1000  mb  temperature 

T925  925  mb  temperature 

T700  *  700  mb  temperature 

T500  500  mb  temperature 

T400  *  400  mb  temperature 

T300  *  300  mb  temperature 

T250  *  250  mb  temperature 

EAIR  Surface  vapor  pressure 

ElOOO  1000  mb  vapor  pressure 

E925  925  mb  vapor  pressure 

E850  850  mb  vapor  pressure 

E700  *  700  mb  vapor  pressure 

E500  500  mb  vapor  pressure 

UBLW  Boundary  layer  zonal  wind  component 
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UIOOO 

U925 

U850 

U700  * 

U500 

U400 

U300 

U250 

VBLW 

VIOOO 

V9  2  5 

V850 

V700 

V500 

V400 

V300 


V250  * 

VOR9  25  ** 

VOR50  0  ** 

PS 

SMF 

PBLD 

STRTFQ 

STRTTH 

SHF 

ENTRN 


DRAG 


*  * 


1000  mb  zonal  wind  component 

925  mb  zonal  wind  component 

850  mb  zonal  wind  component 

700  mb  zonal  wind  component 

500  mb  zonal  wind  component 

400  mb  zonal  wind  component 

300  mb  zonal  wind  component 

250  mb  zonal  wind  component 

Boundary  layer  meridional  wind 
component 

1000  mb  meridional  wind  component 

925  mb  meridional  wind  component 

850  mb  meridional  wind  component 

700  mb  meridional  wind  component 

500  mb  meridional  wind  component 

400  mb  meridional  wind  component 

300  mb  meridional  wind  component 

250  mb  meridional  wind  component 

925  mb  vorticity 

500  mb  vorticity 

Surface  pressure 

Surface  moisture  flux 

Planetary  boundary-layer  depth 

Percent  stratus  frequency 

Stratus  thickness 

Surface  heat  flux 

Entrainment  at  top  of  marine 
boundary- layer 

Drag  coefficient  (Cp^) 


B.   Derived  parameters 
DTDP 


DEDP 
DUDP 


Vertical  gradient  of  temperature 
(1000-925  mbs) 

Vertical  gradient  of  vapor  pressure 
(1000-850  mbs) 

Vertical  gradient  of  zonal  wind 
(1000-850  mbs) 
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DVDP 

RH 
TV 
DDVDP 

DVRTDP 

ESUM 

EPRD 


Vertical  gradient  of  meridional  wind 
(1000-850  mbs) 

Surface  relative  humidity 

Virtual  temperature 

Vertical  gradient  of  geopotential 
height  (1000-850  mbs) 

Vertical  gradient  of  vorticity 
(500-925  mbs) 

Sum  of  vapor  pressures 
(1000-850  mbs) 

Product  of  vapor  pressures 
(1000-850  mbs) 


II.   Area:   Entire  North  Atlantic  Ocean  and  Mediterranean  Sea 

Model  forecast  projection:   1200GMT  (TAU-24) 

15  May — 7  July  1983 


A.   Model  output 
parameter 


DIOOO 

D925 

D850 

D700 

D500 

D400 

D300 

D250 

TAIR 

TIOOO 

T925 

T700 

T500 

T400 

T300 

T250 

EAIR 


Descriptive  name  of  parameter 

1000  mb  geopotential  height 
925  mb  geopotential  height 
800  mb  geopotential  height 
700  mb  geopotential  height 
500  mb  geopotential  height 
400  mb  geopotential  height 
300  mb  geopotential  height 
250  mb  geopotential  height 
Surface  air  temperature 
1000  mb  temperature 
925  mb  temperature 
700  mb  temperature 
500  mb  temperature 
400  mb  temperature 
300  mb  temperature 
250  mb  temperature 
Surface  vapor  pressure 
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ElOOO 
E925 
E850 
E700  * 
E500 
UBLW 
UIOOO 
U9  2  5 
U700  * 
U500 
U400  * 
U300  * 
U250  * 
VBLW 


VIOOO 

V9  2  5 

V850 

V700 

V500 

V400 

V300 

V250 

VOR9  2  5 

VOR500 

PS 

SMF 

PBLD 

STRTFQ 

STRTTH 

SHE 

ENTRN 


DRAG 
PRECIP 


1000  mb  vapor  pressure 

925  mb  vapor  pressure 

850  mb  vapor  pressure 

700  mb  vapor  pressure 

500  mb  vapor  pressure 

Boundary  layer  zonal  wind  component 

1000  mb  zonal  wind  component 

925  mb  zonal  wind  component 

700  mb  zonal  wind  component 

500  mb  zonal  wind  component 

400  mb  zonal  wind  component 

300  mb  zonal  wind  component 

250  mb  zonal  wind  component 

Boundary  layer  meridional  wind 
component 

1000  mb  meridional  wind  component 

925  mb  meridional  wind  component 

850  mb  meridional  wind  component 

700  mb  meridional  wind  component 

500  mb  meridional  wind  component 

400  mb  meridional  wind  component 

300  mb  meridional  wind  component 

250  mb  meridional  wind  component 

925  mb  vorticity 

500  mb  vorticity 

Surface  pressure 

Surface  moisture  flux 

Planetary  boundary-layer  depth 

Percent  stratus  frequency 

Stratus  thickness 

Surface  heat  flux 

Entrainment  at  top  of  marine 
boundary- layer 

Drag  coefficient  (C^^) 

Total  amount  (mm. )  of  model 
precipitation  in  the  last  six  hours 
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SHWRS  Total  amount  (mm. )  of  model  precipita- 

tion associated  with  cumulus  convection 
in  the  last  six  hours 

INSTAB  Boundary  layer  inversion  instability 

DIV925  925  mb  Divergence 


B.   Derived  parameters 

DTDP  Vertical  gradient  of  temperature 

(1000-925  mbs) 

DEDP  Vertical  gradient  of  vapor  pressure 

(1000-850  mbs) 

DUDP  Vertical  gradient  of  zonal  wind 

(1000-850  mbs) 

DVDP  Vertical  gradient  of  meridional  wind 

(1000-850  mbs) 

RH  Surface  relative  humidity 

TV  Virtual  temperature 

DDVDP  Vertical  gradient  of  geopotential  height 

(1000-850  mbs) 

DVRTDP  Vertical  gradient  of  vorticity 

(500-925  mbs) 

ESUM  Sum  of  vapor  pressures 

(1000-850  mbs) 

EPRD  Product  of  vapor  pressures 

(1000-850  mbs) 


III.   Area:   Entire  North  Atlantic  Ocean  and  Mediterranean  Sea 

Model  forecast  projection:   1200GMT  (TAU-48) 

15  May — 9  July  1983 

A.   Model  output    Descriptive  name  of  parameter 
parameter 

DlOOO  1000  mb  geopotential  height 

D925  925  mb  geopotential  height 

D850  850  mb  geopotential  height 

D700  *  700  mb  geopotential  height 

D500  500  mb  geopotential  height 

D400  *  400  mb  geopotential  height 
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D300  * 

D250  * 

TAIR 

TIOOO 

T925 

T700  * 

T500 

T400 

T300 

T250 

EAIR 

ElOOO 

E925 

E850 

E700  * 

E500 

UBLW 

UIOOO 

U925 

U850 

U700  * 

U500 

U400 

U300 

U250 

VBLW 


VIOOO 

V9  2  5 

V850 

V700 

V500 

V400 

V300 

V250 


300  mb  geopotential  height 

250  mb  geopotential  height 

Surface  air  temperature 

1000  mb  temperature 

925  mb  temperature 

7  00  mb  temperature 

500  mb  temperature 

400  mb  temperature 

300  mb  temperature 

250  mb  temperature 

Surface  vapor  pressure 

1000  mb  vapor  pressure 

92  5  mb  vapor  pressure 

850  mb  vapor  pressure 

700  mb  vapor  pressure 

500  mb  vapor  pressure 

Boundary  layer  zonal  wind  component 

1000  mb  zonal  wind  component 

925  mb  zonal  wind  component 

850  mb  zonal  wind  component 

700  mb  zonal  wind  component 

500  mb  zonal  wind  component 

400  mb  zonal  wind  component 

300  mb  zonal  wind  component 

250  mb  zonal  wind  component 

Boundary  layer  meridional  wind 
component 

1000  mb  meridional  wind  component 

925  mb  meridional  wind  component 

850  mb  meridional  wind  component 

700  mb  m.eridional  wind  component 

500  mb  meridional  wind  component 

400  mb  meridional  wind  component 

300  mb  meridional  wind  component 

250  mb  meridional  wind  component 
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VOR  925 

VOR500 

PS 

SMF 

PBLD 

STRTFQ 

STRTTH 

SHF 

ENTRN 

DRAG 
PRECIP 

SHWRS 

INSTAB 
DIV9  2  5 


925  mb  vorticity 

500  mb  vorticity 

Surface  pressure 

Surface  moisture  flux 

Planetary  boundary-layer  depth 

Percent  stratus  frequency 

Stratus  thickness 

Surface  heat  flux 

Entrainment  at  top  of  marine 
boundary- layer 

Drag  coefficient  (C^^) 

Total  amount  (mm. )  of  model  precipitation 
in  the  last  six  hours 

Total  amount  (mm. )  of  model  precipitation 
associated  with  cumulus  convection  in 
the  last  six  hours 

Boundary  layer  inversion  instability 

925  mb  Divergence 


B.   Derived  parameters 
DTDP 


DEDP 

DUDP 

DVDP 

RH 
TV 

DDVDP 

DVRTDP 

ESUM 

EPRD 


Vertical  gradient  of  temperature 
(1000-925  mbs) 

Vertical,  gradient  of  vapor  pressure 
(1000-850  mbs) 

Vertical  gradient  of  zonal  wind 
(1000-850  mbs) 

Vertical  gradient  of  meridional  wind 
(1000-850  mbs) 

Surface  relative  humidity 

Virtual  temperature 

Vertical  gradient  of  geopotential  height 
(1000-850  mbs) 

Vertical  gradient  of  vorticity 
(500-925  mbs) 

Sum  of  vapor  pressures 
(1000-850  mbs) 

Product  of  vapor  pressures 
(1000-850  mbs) 
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*    Parameters  which  were  not  used  due  to  their 
being  considered  as  physically  unimportant 
in  forecasting  marine  visibility. 

**   Parameters  which  were  not  used  due  to  loss  of 
significant  digits  during  transfer  from  tape 
to  mass  storage. 
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APPENDIX  C 
SKILL  AND  THREAT  SCORES,  DEFINITIONS  [Karl,  1984] 


:;3 

R 

S 

T 

< 

o 

LU     2 

U 

V 

W 

O 
^     1 

X 

Y 

Z 

1      2      3 

OBSERVED 


Total   =   R+S+T+U+V+W+X+Y+Z 

PI   =   (R+U+X) /Total      P3   =   (T+W+Z ) /Total 

P2   =   (S+V+Y)/Total      PN   =   greatest  of  Pi,  P2  or  P3 

Raw  Scores 

AO   =   %  correct   =   (X+V+T) /Total 


Al   =   one-class  error 


(U+S+Y+W) /Total 


TSl   =   Threat  score  for  visibility  category  I 
=   X/(R+U+X+Y+Z) 

TS2   =   Threat  score  for  visibility  category  II 
=   V/(S+V+Y+U+W) 

TS12   =   Threat  score  for  visibility  categories  I  and  II 
(X+V)/(Total-T) 
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TS12  is  designed  to  represent  the  skill  of  forecasting 
visibility  categories  I  and  II  as  separate  categories, 
rather  than  their  skill  as  a  combined  category,  which 
would  be  (U+V+X+Y) /(Total-T) . 


Adjusted  scores 

AAO   =   (A0-PN)/(1-PN) 

ATSl   =   (TS1-P1)/(1-P1) 

ATS2   =   (TS2-P2)/(1-P2) 

ATS12   =   (TS12-(P1+P2) )/(l-(Pl+P2) ) 
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APPENDIX  D 

BMDP  LINEAR  REGRESSION  EQUATION  PREDICTOR  SETS, 
NORTH  ATLANTIC  OCEAN  EXPERIMENTS  (PR+BMD  MODEL) 

I.  Area  2,    TAU-00  (BMDP  P2R) 

BMDl   =   2.842  -  0.21767*E850  +  0 . 837882E-05*D500 

+  0.03293*SHF  +  7.057*DTDP  +  0.05872*ESUM  ** 

BMD2   =   -10.4469  +  0.11854*EAIR  +  0.10124*SMF 

-  0.07409*T925  -  0.16481*E925 

BMD3   =   3.47713  -  0.22482*EM  +  45 . 06116*DEDP 
+  0.00521*EPRD 

II.  Area  2,  TAU-24  (BMDP  P9R) 

BMDl   =   -20.9733  -  0.20905*E850  -  0 . 078694*T925 
+  0.0533674*SHF  -  0 . 0316725*INSTAB 
+  0.0862939*TV  +  0 . 0862983*ESUM 

BMD2   =   2.68106  +  0.0356103*TM  +  0 . 53048E-04*V500 

-  0.141302*E925  +  22.0764*DEDP 

+  0.0125618*DDVDP  +  0 . 00563327*EPRD  ** 

BMD3   =   -35.2882  +  0.0381891*PS  +  0 . 0273575*T500 
+  0.00449538*PBLD  -  0 . 00625203*STRTFQ 

-  0.0083686*STRTTH  +  0 . 00272894*DTDP 

III.  Area  2,    TAU-48  (BMDP  P9R) 

BMDl   =   -37.7157  -  0 . 147084*E500  -  0 . 0897567*T925 

-  0.128407*E925  +  0.022881*SHF  +  0 . 00860574*RH 
+  0.145537*TV 
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BMD2   =   1.85487  +  0.0777253*TM  -  0 . 0266753*E850 

-  0.0000390116*U500  -  0 . 0000366663*V500 
+  0 .0240246*DDVDP  +  0 . 105648*ESUM   ** 

BMD3   =   -13.9637  +  0.0160572*PS  +  0 . 00308705*PBLD 

-  0.0031323*STRTFQ  -  0 . 00 84644 3 *DTDP 
+  25.6871*DEDP  -  0 . 0029 6342*EPRD 


IV.  Area  3W,  TAU-24  (BMDP  P2R) 

BMDl   =   2.673  -  0.09363*E850  -  0.05101*T925 

-  0.20451*E925  +  0.0305*SHF  +  0.15111*ESUM   ** 

BMD2   =   1.15536  +  0.16326*EAIR  +  0.01509*SMF 
+  0 .13014E-04*DM  +  8.08795*DEDP 
+  0.02091*DDVDP  -  0.00788*EPRD 

BMD3   =   -18.55031  +  0.02089*PS  -  0 . 30643E-03*VBLW 

-  0.01151*STRTFQ  +  0 . 02772*STRTTH 

-  0.05736*DUDP 

V.  Area  3W,  TAU-4  8  (BMDP  P9R)  .  • 

BDMl   =   1.92874  -  0 . 0719 817*T925  -  0 . 201663*E9 25 

+  0.0376905*SHF  +  7.66796*DEDP  +  0 . 182705*ESUM 

-  0.00585094*EPRD 

BMD2   =   -33.2574  -  0.1459*E850  -  0 . 000205441*V925 

+  0.325802*SHWRS  +  0.0168064*RH  +  0.124434*TV 
+  0.0  24  72  7  7*DDVDP   ** 

BMD3   =   -10.1316  +  0.0126085*PS  -  0 . 00032403*VM 
+  0.000112099*U500  -  0 . 00880168*STRTFQ 
+  0.0159356*STRTTH  -  0 . 00174911*DRAG 
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VI.  Area  4,  TAU-00  (BMDP  P2R) 

BMDl   =   2.86828  +  0 . 4877E-04*U500 

-  0.64632E-04*V500  -  0 . 30475E-02*STRTFQ 

BMD2   =   2.70156  +  0 . 14946E-04*DM  -  0 . 00904*STRTTH 
+  0.01888*SHF  +  4.09377*DTDP   ** 

BMD3   =   2.84881  +  0 . 24549E-03*VBLW  -  0.10113*E£50 

-  0.25666E-3*V850  +  0.03273*ESUM 

VII.  Area  4,  TAU-24  (BMDP  P9R) 

BMDl   =   3.00017  +  0.0773367*TM  -  0 . 0000464491*V500 

-  0.103205*T925  -  3 . 76267*VRT925 

-  0.000477853*DTDP  +  9.51302*DEDP 

BMD2   =   3.05949  -  0 . 088302*E500  +  0 . 00372204*PBLD 

-  0.00492842*STRTFQ  +  0 . 0154289*SHF 

-  1.89105*VRT500  +  0 . 0143745*DVDP   ** 

BMD3   =   -24.6366  +  0 . 00275966*PS  -  0 . 0549077*E850 
+  0.195977*T500  +  0 . 0140852*INSTAB 
+  0.0886378*TV  +  0 . 0231264*DDVDP 

VIII.  Area  4,  TAU-48  (BMDP  P9R) 

BDMl   =   -27.0959  -  0 . 0732462*E850  +  0.01616*T500 

-  0.117787*T925  +  0 . 287098*SHWRS 

-  4.13253*VRT925  +  0.111855*TV   ** 

BMD2   =   -3.1619  +  0 . 00678538*PS  -  0 . 0850887*E500 

-  0.0000502297*U500  -  0 . 0000396501*V500 

-  0.00389051*STRTFQ  -  0 . 00917554*RH 
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I 


BMD3   =   2.08319  +  0.0771067*TM  -  0 . 0282767*E925  ■ 


** 


-  1.5829*VRT925  -  0 . 00114379*DTDP 
+  13.2073*DEDP  +  0  .  0289832*DDVDP 


Equation  selected  as  predictors  in  the  PR+BMD  model 


i 
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APPENDIX  E 

BMDP  LINEAR  REGRESSION  EQUATION  PREDICTOR  SETS 
FOR  TWO-STAGE  THRESHOLD  MODELS 

I.  Area  2,  TAU-00  Threshold  Equations  (BMDP  P2R) 

a.  VISCAT  I  vs.  VISCAT  II+III  separation 

VIS   =   0.87475  -  0.11042*E850  +  0.01173*SHF 
+  2.61984*DTDP  +  0.03863*ESUM 

b.  VISCAT  II  vs.  VISCAT  III  separation  (EVAR  model) 

VIS   =   1.03838  +  0.03668*EAIR  -  0.10423*E850 
+  0.01560*SHF 

c.  VISCAT  II  vs.  VISCAT  III  separation  (QUAD  model) 

VIS   =   1.03730  +  0.03727*EAIR  -  0.10505*E850 
+  0.01552*SHF 

II.  Area  2,    TAU-24  Threshold  Equations  (BMDP  P9R) 

a.  VISCAT  I  vs.  VISCAT  II+III  separation 

VIS   =   0.792157  -  0.00404602*SMF  +  0.0271941*TM 

-  0.0767329*E850  -  0 . 0385021*T925 

-  0.0656522*E925  +  0 . 0683159*ESUM 

b.  VISCAT  II  vs.  VISCAT  III  separation  (EVAR  model) 

VIS   =   -13.9955  -  0.0612856*E850 

+  0.0478582*SHF  -  0 . 0303761 *INSTAB 

-  1.585*VRT925  +  0.0539318*TV 
+  0.0102962*DDVDP 
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c.   VISCAT  II  vs.  VISCAT  III  separation  (QUAD  model) 

VIS   =   -13.1384  -  0.107716*E850 
+  0.00002923*V500 
+  0.0122899*SHF  +  0.0498382*TV 
+  0.0105859*DDVDP  +  0 . 0232983*ESUM 


III.  Area  2,  TAU-48  Threshold  Equations  (BMDP  P9R) 

a.  VISCAT  I  vs.  VISCAT  II+III  separation 

VIS   =   -18.0327  -  0.0569882*E850 

-  0.104458*T925  -  0 . 00116092*PBLD 
+  0.0957819*PRECIP  -  0.0705180*TV 

-  0.0118901*DVDP 

b.  VISCAT  II  vs.  VISCAT  III  separation  (EVAR  model) 

VIS   =   -14.4404  -  0.0670910*E850  -  0.11931*E500 
+  0.0157788*SHF  -  0 . 023835*DUDP 
+  0.0551551*TV  +  0.00761201*DDVDP 

c.  VISCAT  II  vs.  VISCAT  III  separation  (QUAD  model) 

VIS   =   -56.9191  -  0.168467*TM  -  0 . 116816*E500 
+  0.0201013*SHF  +  0.000599864*DTDP 
+  0.210713*TV  -  0.0487371*ESUM 

IV.  Area  3W,  TAU-24  Threshold  Equations  (BMDP  P2R) 

a.   VISCAT  I  vs.  VISCAT  II+III  separation 

VIS   =   0.88319  -  0.04039*E850  -  0.03385*T925 

-  0.11313*E925  -  0.02692*DVDP 
+  0.0843*ESUM 
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b.  VISCAT  II  vs.  VISCAT  III  separation  (EVAR  model) 

VIS   =   0.59606  +  0.000012576*DM 

+  0.0151*INSTAB  +  10.23334*DEDP 

-  0.0019117*EPRD 

c.  VISCAT  II  vs.  VISCAT  III  separation  (QUAD  model) 

VIS   =   0.73427  -  0.12863*E850  +  0 . 0015056*PBLD 
+  0.02073*SHF  +  0.04270*ESUM 

V.  Area  3W,  TAU-48  Threshold  Equations  (BMDP  P9R) 

a.  VISCAT  I  vs.  VISCAT  II+III  separation 

VIS   =   0.424612  -  0.0000997789*VM 

+  0.0000403063*U500  -  0 . 0360747*T925 

-  0.132972*E925  +  0 . 114795*ESUM 

-  0.00286176*EPRD 

b.  VISCAT  II  vs.  VISCAT  III  separation  (EVAR  model) 

VIS   =   -7.19287  -  0.000788627*PS 

-  0.0685555*E850  -  0 . 05799 88*E500 
+  0.0222827*SHF  +  0 . 195715*SHWRS 
+  0.0208835*ESUM 

c.  VISCAT  II  vs.  VISCAT  III  separation  (QUAD  model) 

VIS   =   -7.28759  -  0 . 000797890*PS 

-  0.701888*E850  -  0  .  0547155*E500 
+  0.0226117*SHF  +  0 . 202564*SHWRS 
+  0.0212283*ESUM 

VI.  Area  4,  TAU-00  Threshold  Equations  (BMDP  P2R) 

a.   VISCAT  I  vs.  VISCAT  II+III  separation 

VIS   =   0.98483  -  0.75281E-03*STRTFQ 
+  0.70578*DTDP 

115 


VII.  Area  4,  TAU-24  Threshold  Equations  (BMDP  P9R) 

a.  VISCAT  I  vs.  VISCAT  II+III  separation 

VIS   =   -3.02386  -  0.200326*T925 

-  0.000654475*STRTFQ  -  0 . 000295813 *DRAG 

-  0.466227*VRT925  -  0 . 0019 2255*RH 
+  0.0153547*TV 

b.  VISCAT  II  vs.  VISCAT  III  separation  (EVAR  model) 

VIS   =   1.19369  -  0.0709575*E500 

-  0.000617273*V500  +  0 . 19 3681*SHWRS 

-  0.000551506*DRAG  -  2 . 96306*VRT925 

-  0.0180048*DUDP 

c.  VISCAT  II  vs.  VISCAT  III  separation  (QUAD  model) 

VIS   =   1.36198  -  0.0737982*E500 

-  0.000061033*V500  +  0 . 185475*SHWRS 

-  3.05142*VRT925  -  0 . 0184565*DUDP 

-  0.00185381*RH 

VIII.  Area  4,  TAU-48  Threshold  Equations  (BMDP  P9R)  ,  ■ 

a.  VISCAT  I  vs.  VISCAT  II+III  separation 

VIS   =   -8.24765  -  0 . 0085996*T500 

-  0.0333863*T925  -  0 . 0177121*E925 

-  0.00059629*STRTFQ  +  0 . 000128675*DTDP 
+  0.0343295*TV 

b.  VISCAT  II  vs.  VISCAT  III  separation  (EVAR  model) 

VIS   =   1.20788  -  0.026601*E850 

-  0.0000310346*U500  -  0 . 0000480308*V500 
+  0.203575*SHWRS  -  3 . 2719 *VRT92 5 

+  4.10651*DEDP 
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VISCAT  II  vs.  VISCAT  III  separation  (QUAD  model) 

VIS   =   -12.5384  -  0.0397823*E850 

-  0.0000388604*V500  -  0  .  043269 *T925 
+  0.201266*SHWRS  -  3 . 46254*VRT925 
+  0.0500493*TV 
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APPENDIX    F 
TABLES 
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TABLE  IV.   Number  of  observations  of  three  visibility 
categories  and  95%  confidence  intervals  for 
the  dependent  and  independent  FATJUNE  19  83 
data  for  the  North  Atlantic  Ocean  homogeneous 
areas  2  and  4,  for  TAU-00,  TAU-24  and  TAU-48 
and  area  3W  for  TAU-24  and  TAU-4  8 


TAU 

00 

Area 

2^ 

Total 

VISCAT  I 

VISCAT  II 

VISCAT  III 

DEP 

1912 

190  (.099) 

214  (.112) 

1508  (.789) 

IND 

955 

87  (.091) 

103  (.108) 

765  (.801) 

95% 

C.I. 

(.086-. 107) 

(  .099-. 122) 

(  .778-. 808) 

Area 

J_ 

Total 

VISCAT  I 

VISCAT  II 

VISCAT  III 

DEP 

3181 

85  (.027) 

400  (.126) 

2696  (.848) 

IND 

1590 

44  (.028) 

197  (.124) 

1349  (.848 

95% 

C.I. 

(.022-. 032) 

(.116-. 135) 

(.838-. 858) 

TAU 

24 

Area 

J_ 

Total 

VISCAT  I 

VISCAT  II 

VISCAT  III 

DEP 

1760 

180  (.102) 

206  (.117) 

1374  (.781) 

IND 

879 

71   (.084) 

98   (.111) 

710   (.808) 

95% 

C.I. 

(.081-. 106) 

(.103-. 127) 

(.774-. 805) 

Area 

3W 

Total 

VISCAT  I 

VISCAT  II 

VISCAT  III 

DEP 

1415 

270  (.191) 

173  (.122) 

972  (.687) 

IND 

707 

137  (.194) 

89   (.126) 

481  (.680) 

95% 

C.I. 

(.173-. 205) 

(  .109-. 137) 

(  .665-. 705) 

Area 

4 

Total 

VISCAT  I 

VISCAT  II 

VISCAT  III 

DEP 

2938 

81  (.028) 

368  (.125) 

2489  (.847) 

IND 

1469 

38  (.026) 

175  (.119) 

1256  (.855) 

95% 

C.I. 

(.022-. 032) 

(.114-. 133) 

(.839-. 860) 
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TABLE  IV  (CONTINUED) 

TAU  4  8 

Area  2  Total  VISCAT  I  VISCAT  II  VISCAT  III 

DEP  1852  182  (.098)  230  (.124)  1440  (.778) 

IND  925  91   (.098)  107  (.116)  727   (.786) 

95%  C.I.  (.087-. 109)  (.109-. 133)  (.765-. 796) 

Area  3W  Total  VISCAT  I  VISCAT  II  VISCAT  III 

DEP  1487  290  (.195)  186  (.125)  1011  (.680) 

IND  743  132  (.178)  111  (.149)  500   (.673) 

95%  C.I.  (.173-. 205)  (.119-. 147)  (.658-. 697) 

Area  4  Total  VISCAT  I  VISCAT  II  VISCAT  III 

DEP  3056  109  (.036)  406  (.133)  2541  (.831) 

IND  1527  45   (.029)  196  (.128)  1286  (.842) 

95%  C.I.  (.028-. 039)  (.122-. 141)  (.824-. 846) 
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APPENDIX  G 
FIGURES 


OPERRTIONRL  U.S.  NRVY 
MODEL  OUTPUT  STRTISTICS  (MOS 
DEVELOPMENT  SCHEDULE 


^^> 

^%^ 

VISIBILITY 
CEILING 
CLOUD  RMOUNT 
OBSTR  TO  VIS 

SIG  WAVE  HT 
WIND  WAVES 
OCEAN  SWELL 

SEC  WIND 
SEC  TEMP 
SPC  DEWPOINT 

PRECIP  OCCUR 
PRECIP  RMT 
TRW  OCCUR 

NORTH  RTLRNTIC 

MEDITERRRNERN 
NORTH  PRO  I  PIC 

INDIAN 

SOUTH  RTLRNTIC 

SOUTH  PRCIPIC 

1987 
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1991 
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1991 

1992 

Figure  1.   Proposed  U.S.  Navy  Model  Output  Statistics 
(MOS)  development  schedule 
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Figure  9.   Contingency  table  results  for  the  area  2, 
TAU-00  equal  variance  threshold  model 
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Figure  10.   Contingency  table  results  for  the  area  2, 
TAU-00  quadratic  threshold  model 
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Figure  17.   Contingency  table  results  for  the  area  2, 
TAU-24  equal  variance  threshold  model 
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Figure  18. 


Contingency  table  results  for  the  area  2, 
TAU-24  quadratic  threshold  model 
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Figure    25. 


Contingency  table  results  for  the  area  2, 
TAU-48  equal  variance  threshold  model 
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Figure  33.   Contingency  table  results  for  the  area  3W, 
TAU-24  equal  variance  threshold  model 
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Figure  34.   Contingency  table  results  for  the  area  3W, 
TAU-24  quadratic  threshold  model 
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Figure    41. 


Contingency  table  results  for  the  area  3W , 
TAU-48  equal  variance  threshold  model 
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Figure  42,   Contingency  table  results  for  the  area  3W, 
TAU-48  quadratic  threshold  model 


188 


u 

o 

■"T" 

-Ol 

cc 

CJ 

UJ 

cc 

__ 

t— t 

,   1 

01 

1 

(— 

ca 

CD 

crcj 

; 

-oo 

■z. 

O 

ocn 
en  ^— 

•— ' 

=) 

— .  >• 

r.  1 

Q_ 

cr 

> 

M 

n 

H- 

UJ 

o 

a  cc 

(T) 

q: 

1 

(E  o 

C3 

LJ 

CJ 
1—  CD 

' 

CS 

Li_ 

2= 

ZUJf-i 

Q_ 

a 

QJ 

ujao: 

=) 

X 

OJZOJ 

O 

o 

o 

CD 

ljujq: 

LiJf-r 

a 

CS 

[—1 

,__, 

• 

■  \ 

CJ 
LJ 

'— ' 

□  C3 
LJZ 

) 

-to 

; 

CD 

tn 

M 

a 

13     • 

cn 

Q. 
X 

tree 

cr 

1    1 

2= 

X   • 

-U) 

_ 

S-Q 

k-0 

I   3 

1                  1                  1                  1                  1                  1 
£-Q             J-Q             to             Q-Q             fO-           Z'Q-         £'0 

yoDS  iu3yHi  'ONI  Toy  /ou  •d3a  Toy 

-* 

TJ 

73 

Q) 

OJ 

-P 

4J 

O 

W 

H 

QJ 

D 

QJ 

H 

M 

•n 1 

^-1 

QJ 

T3 

0 

CQ 

U) 

(T3 

u 

o 

m 

vc 

W 

0) 

cu 

fT3 

x: 

4-) 

X 

5 

-P 

(T3 

(D 

g 

+J 

0 

M 

x; 

-p 

x; 

«. 

Cji 

-p 

r-l 

•H 

OJ 

QJ 

QJ 

N 

M 

T3 

•H 

0 

>+-i 

W 

< 

6 

0 

CnU 

« 

0) 

C 

en 

a, 

N 

•H 

M 

- — 

■H 

a> 

W 

D 

o 

0 

-tJ 

o 

Cn 

u 

OJ 

1 

C 

tn4-i 

D 

•H 

to 

< 

a 

en 

P 

H 

p 

D 

•i—i 

0 

0 

xi 

«. 

Sh 

-H 

(T3 

•^ 

en 

a 

a  OJ 

(13 

fd 

0 

j:: 

QJ 

a+j 

>-i 

QJ 

fd 

w 

>,T) 

(d 

rH 

c 

U 

u 

.-1 

(T3 

0 

td 

M-i 

0) 

p 

, — , 

•H 

cr  (T3 

— ^ 

x: 

0) 

4J 

(T3 

-p 

(0 

-P 

4-1 

'TJ 

n3 

u 

0 

TJ 

0 

+J 

fc 

a 

C 

-P 

-H 

0) 

C 

x: 

Td 

Q) 

• 

w 

c 

T3 

.-^ 

c 

QJ 

G 

>^ 

0 

a  QJ 

cr> 

•H 

QJ 

O*  QJ 

-P 

■D 

QJ 

-p 

(T3 

^ 

t3 

fd 

rH 

C 

i-i 

0) 

o 

H 

+J 

cc; 

< 

^~^ 

w 

ro 

•<3' 

0) 

V^ 

D 

Di 

•H 

fc 

189 


^ 

N 

N 

Tf 

CO 

o 

lO 

o 

o 

o 

^- 

o 

o 

1 

1 

» 

(N 

^ 

<N 

o 

1/1 

U1 

(/) 

< 

h- 

h- 

>— 

< 

< 

< 

4 

?^ 

^ 

in 

CVJ 

N- 

If) 

^ 

Tj- 

CJ 

o 

'  . 

Cvj 

10 

o 

o 

o 

00 

T- 

n 

CN 

u 

^ 

CN 

o 

«» 

1/1 

t/» 

cn 

<* 

< 

t- 

t- 

►- 

< 

Q 

t- 
Z 
liJ 
Q 
Z 
ai 
a 

lU 

Q 

z 


CO 

ID 

a 


^ 

eg 
CO 

0) 

CO 

CO 

o 

6 

o 

n 

" 

w* 

rt 

o 

If) 

1/1 

(/I 

< 

f— 

h* 

^ 

< 

< 

< 

< 

^ 

CO 

c^ 

r- 

q 

<3) 

lO 
CO 

CVJ 

6 

00 
C) 

CO 
CD 

CD 
CN 

00 

00 

in 

CM 

r- 

«* 

CO 


T-  "^ 


iSV03dOJ 


< 
Q 


2 

a 

z 

UJ 

c 
m 
Q 


0) 
00 

CN 

CO 

T— 

CO 
CO 

1^ 
co 

CO 

o 

^ 

0) 

CN 
(O 

CjJ    o 


CD 


ct: 
o 

CJ 

en 


en  " 


en  Sc 

Ct::  cc 

o  ^ 

CJ  ^ 

5  £ 

{jj  q: 

Ct:  "^ 

L.  § 
I— 

LJ 
CD 


- 

o 

ct 

X 

o 

a: 

CE 

e- 

T' 

CJ 

-L 

r,i 

a. 

t— 

• 

• 

rn 

CL 

Q_ 

lil 

• 

• 

LJ 

U 

1 

a. 

a. 

t:i 

CI 

[i] 

li) 

i- 

2 

CJ 

CJ 

*"• 

^^ 

□ 

* 

X 

• 

[  lyosiA  3yoos  iy3iiHi  ?  Ob  aaisnroy 


-1 — 


cc 

CJ 


o 

o 

1 

1 

rt: 

B^ 

(U 

x: 

-  >i 

+j 

'<3'     U 

C    0) 

-p 

fO    dJ  ^ 

03 

(U   Cn-P 

M  c 

n3 

n  -H  s: 

(U 

-p  -p 

> 

S-l    C  -H 

Q) 

0  0   ^ 

•H 

4-1    u 

x: 

TD 

o 

t/)    0)    0) 

03 

■P  -C   -P 

nH  E-<    fT3 

QJ 

P          -H 

M 

(/]         u 

0 

0)     •    0 

O 

>-i  >i  cn 

en 

cr>  en 

dJ    QJ    (T3 

4-> 

.-1  +J 

03 

X!  fd   w 

CU 

fd  s^  (u 

S-l 

-P  -P   J-i 

x: 

en  0 

-p 

>i        u 

u  M  tn 

M 

c 

(U  CQ    CJ 

£h 

cnO  CO 

< 

c  «   0 

U 

•H  a,  x: 

cn 

-p  x:  +j 

M 

c  < 

>  -^ 

0  S   0 

GJ 

U         -P 

•P   > 

CU 

C    (D 

"O  x:  fi 

(U  <-{ 

c  -p  "o  n 

03        c 

C    >-i 

u  o 

0)    0 

e  0  a 

a-p 

(13  m    W 

Q)    U 

>-l           0)  10  -H 

CP--   s-l 

C  T3 

03  .-(    5-1 

•H    OJ 

•H    0)    0 

5-1 

73  T3    U 

e  a 

0 

p 

nH    e    0) 

e  x: 

^         M 

•H    4-1 

•H   PC   XI 

X  4-1 

Ai   Pi     03 

03  -H 

cn  --  -P 

e  ^ 

n3 

■^ 

•^ 

0) 

M 

p 

cr> 

•H 

fo 

190 


HZ 

00 

CO 

I 

II 

o 

< 
< 

iq 
oj 
^r 

o 

< 


00 

o 


CO 
o 


O) 
CNl 

1^ 


o 
o 

CD 

<->      — 

II  "  M 

^  (^  r- 

trt  U1  U1 

<        <         < 

-    u^     !^ 


# 

CM 

h- 

^_ 

o 

00 

t^ 

00 

CO 

o 

00 

o 

6 

o 

n 

w- 

M 

o 

in 

10 

ifl 

< 

t- 

h- 

h- 

< 

< 

«< 

< 

?(5 

CO 

2^ 

f^ 

CO 

q 

oi 

6 

CO 
CO 

CD 

CO 
6 

" 

It 

,. 

(N 

o 

lO 

1/1 

1/1 

< 

< 

t- 

1- 

t- 

< 


a 

z 
ai 
a. 

UJ 
Q 

2 


CD 

LJ 

ID 

a 


00 

o 

CN 

in 

CM 

CO 
CO 

00 

CO 

CN 

^ 

en 

o 

UJ 

> 
cr 
m 
10 

o 
o 


isvoaaoj 


< 

Q 


Z 
LU 
Q 

Z 

LU 
C 
UJ 
Q 


T— 

CM 
(0 
CM 

5 

^ 

00 

in 

00 
CO 

t^ 

- 

CM 

CM 
00 

iSvoaaoj 


X 

03 

ri 

L. 

LJ 

CD 

cc 
1-' 

F— 1 

LJ 

z 

M 

LJ 

rn 

CD 

V 

z: 

fO 

►— * 

^ 

in 

ct: 

n 

UJ 

f  ) 

33 

^ 

CJ 

O 

U) 

CS 
1 

i— 

m 

en 

I^ 

K 

^ 

m 

n 

C  ) 

(  ) 

rtr 

> 

(/) 

a. 

Q 

Q^ 

rr 

^ 

(   ) 

i: 

O 

E-' 

1 

in 

r  ) 

> 

■«" 

tn 

f  1 

a: 

cc 

LU 

UJ 
or 

a: 

<r 

CJ 

Q_ 

1 

L_ 

o 
n 

n 

LJ 

13 

tr 
1— 

cr 

LJ 

OQ 

« 

— 

o 

cc 

X 

r~) 

cc 

U- 

l— 

?■ 

o 

i 

til 

a: 

s- 

• 

rn 

U- 

a. 

fi  1 

• 

■ 

Ul 

UJ 

1 

a. 

n- 

(.1 

a 

UJ 

ii  1 

^ 

^ 

o 

CJ 

o 

• 

X 

• 

cc 

UJ 
OQ 

z: 


Q-I 


8'0  9-0  VQ  ZO  Q-0  ZQ-  »■■[)- 

r  Ly39iA  3yo3S  lyG^Hi  ?  ou  a3isnraB 


9-Q- 


0) 

O  -H 

O  X! 

1     (13 

3  -P 

< 

H    >i 

O 

e  x: 

-  c 

p 

4J 

^    0) 

e 

U-i 

cr^ 

-H 

•H 

Q)   c 

X 

m 

M  -H 

nj 

fd  +J 

e 

0) 

c 

x: 

U   0 

0) 

4-1 

0  u 

x: 

^ 

4-1 

4-1 

<D 

(C 

(/5  x:  x; 

+J  H 

4J 

■n 

r-l 

•H 

<D 

p 

5 

> 

w    • 

QJ 

0)    >iTi 

•H 

)>4   en  0)  j: 

0) 

+J 

U 

0)  4-1 

rd 

(T3 

rH    rtJ 

•H 

i2   u 

u 

0) 

fO  -U 

0 

5-1 

4-1    CO 

en 

0 

en 

U 

>lM 

(0 

tn 

U   H 

c 

to 

4J 

0)  CQ 

0) 

m 

cno 

J-i 

(D 

C  D:^ 

0 

5-1 

■H   Oi 

0 

x: 

4J  X 

en 

4J 

0   S 

OJ 

M 

u 

en 

Q) 

0 

ir< 

T)  x: 

x: 

< 

C   4-> 

4-1 

u 

n3 

CO 

iH 

i-( 

0 

M 

Q) 

E   0 

4-1 

> 

> 

ra  4-4 

QJ 

M 

en 

4-1 

M 

en-. 

T3 

c 

rO  rH 

C 

d) 

5-1 

■H    0) 

0  T3 

0 

T3  TD 

&,  C 

4-1 

0 

en 

<D 

u 

-H    g 

QJ 

a 

■H 

rH 

5-1 

(U 

Ti 

•H   a 

S-l 

TD 

QJ 

^   0. 

0 

c 

5-J 

in  -- 

U 

■H 

a, 

^ 

■^ 

■^ 

(D 

U 

P 

cn 

•H 

&4 

191 


CO 

od 

CM 

I 

II 

o 

o 
in 

d 

OD 

o 

< 


o 

CO 


"* 

in 

CJ 

o 

o 

u 

o 

o 

o 

,, 

M 

<N 

^- 

P( 

in 

to 

in 

(- 

H- 

f- 

< 

< 

< 

r- 

h- 

CD 

o 

. 

CD 

O 

O 

< 

Q 


Z 

LU 

Q 
Z 
liJ 
O. 
UJ 
Q 
Z 


CO 


X  CO 

QJ  O 

M 

CD  7, 

,    ,  cs 

ct:  - 

o  ^ 

O  o 


CO  (^ 

o  =^ 

o  ^ 

5  £ 

LJ  ce 

ct:  "= 

Q_  I 

o  i 

i— 

ce: 

LJ 
GQ 


CJ) 

T— 

CN 

CN 
CN 

CO 

If) 
CO 

lO 

in 

CN 

CO 

-. 

't 

isvoaaod 


< 


2 
lU 
O 

z 
c 

LU 


CM 
CO 

II 

o 

< 
< 

in 

CO 


CO 
CO 


o 


10 

►- 
< 

CD 


CM 
CD 


in 


d 


CN 

C4 
CN 

o 

CO 
(O 

CO 

o 

O 

in 

CN 

o 

CO 

iS»03aoj 


— 

— 

n 

X 

n 

LC 

0. 

f- 

■^ 

o 

I. 

fii 

a. 

I— 

• 

rn 

u. 

a. 

fi  1 

■ 

■ 

OJ 

LJ 

Q 

Q 

o 

Q 

U\ 

111 

^ 

i' 

O 

a 

a 

♦ 

X 

• 

— r 

9-0 


— r 


— I — 


— r~ 

2-0- 


o 


OJ 
CO 

Z2 


80  g-O  VQ  E'O  Q-0  2-0-  ►•Q- 

[  idOSiA  3yoos  ibsyHi  ?  ob  a^isnray 


9-0- 


>1 

u 

O     C 

o  OJ  e 

1     en  3 

DCS 

<:  -H  -H 

tH    +J      X 

c  to 

-  0  e  x: 

"^    U         4-1 

OJ  4-1 

(Tj  cu  x:  -H 

(u  x;  4-1 4-4 

U   Eh 

(d      x:  0) 

■p  s: 

U      •  -H   4-) 

0    >,  5 

4-1    en       4-1 

0)  T3   fO 

W  4-)   <U 

4-1    n3  4-1  T3 

.H    ^    (T3   0} 

P   4J  -H    > 

w  en  0  0) 

0)          0  -H 

V4  c  w  x: 

0  w  u 

(U  -H  fc  (d 

n-l     W 

i2  en  tn  (U 

(T3    0)    0)    ^4 

4-1    )-l    S-l    0 

tJi  0   u 

>i  (U  0  en 

u  >-i  tn 

C                    4-1 

0)  i-H    OJ    rtJ 

CTi  (T3  en  OJ 

C    >-i    0    >-i 

■H    a  X  X 

4-1   4J    4J   4J 

C    03 

O    C    0  M 

U         4-1 

OJ         Eh 

T3  X  tn  < 

C  4J  T!  U 

fO          C  W 

iH 

V4    0   M 

0) 

E  0  a> 

> 

(T3  4-1    en 

0) 

Sh           QJ   4J 

rH 

en—  s-i  c 

(T3    nH     V4     0) 

V4 

■rH      OJ      0    TD 

0 

TD  T3    0    C 

4J 

0         OJ 

u 

rH  e  (u  a 

•H 

i-l          -H    CU  13 

•r4    CC;  XI  TD 

OJ 

^  Dh  fd  c 

u 

en  -^  4J  -H 

a 

• 

"«^ 

■^J* 

0) 

u 

3 

tJ^ 

•H 

P^ 

192 


o 

< 

CO 

00 

CO 

(0 

CO 

CVJ 

< 

(0 

cvi 

CvJ 

0) 

T— 
T- 

CI) 
CO 

10 
c\i 

(O 
0) 

o 
< 

CO 
CO 

CD 

CD 
10 

0 

CO 

o 
< 

CO 
CO 

0 

-^ 
CO 

CD 

in 

CO 

00 

0) 

o 

u. 

Oi 

1— 

00 

CVJ 

6 

CO 

d 

CO 

CO 
d 

in 

CM 
CV| 

d 

Q 

u. 

(0 

0 
d 

0 

00 
CO 

CD 

0 
a> 

CO 

1— 
d 

10 

0) 

d 

CO 

00 

y— 
CVI 

d 

o 
o 

■5 
0 

Q. 

0 
0 

> 

Q. 
Q 

> 

X 

h- 
f- 
□c 
1- 
co 

0 
0 

10 

UJ 

1- 

Z 
UJ 

o\o 

LO 

0  Di 

\.a^ 

o\o  ^^ 

V£) 

CTi   0 

0 

T!     1 

C  D 

td  <C 

E-i 

cn 

u    - 

■H   -^ 

4-) 

W    (T3 

■H    0) 

4-)    S-l 

(T3     03 

4J 

W    >-l 

0 

<-{   U-l 

<: 

\  w 

^~. 

0  cu 

>i 

<:  p 

tJi 

r— 1 

QJ 

-  (13 

+J 

QJ    > 

fd 

U 

u 

C  -H 

U) 

0)  fd 

T3    > 

M 

C    M 

H 

0)    0) 

a-u 

CQ 

(U   c 

0 

13  -H 

« 

cu 

1— 1    0) 

X 

(d  u 

< 

c  c 

s 

0   0) 

•H   13 

•. 

-P   -H 

rH 

U    M-l 

0) 

c  c 

13 

:=!  0 

0 

Cu   u 

e 

• 

in 

^ 

QJ 

M 

P 

CP 

•H 

fa 

193 


\              '* 

o 

•f 

\      \ 

-o> 

cr 

LJ 

\             * 

UJ 

a: 
cr 

\      \ 

»— t 

, , 

\       1 

CO 

1 

f- 

\       '^ 

(-cc 

y      * 

-CD 

CD 

a 

cr  c_3 

\ 

:z 

o 

3 

CJ  en 
on-- 

LJ 

Q_ 

cc 

> 

1 

M 

3 

E- 

UJ 

» 

a 

oq; 

* 

tn 

az 

I 

OIO 

^ 

CD 

LJ 

o 
t- tn 

: 

[       t 

Li- 

ZI 

zc-Ji- 

\        ; 

CL 

O 

LJ 

ijoai 

\        1 

rj 

X 

fiZtiJ 

\       . 

O 

o 

CO 

LEI 

DEPE 

THR 

\l 

a: 
c^ 

(— . 

\    1 

CJ 

,     ^ 

acD 

c    • 

-<D 

UJ2 
E— <  — • 

_J 

en 

CD 

LJ 

o 

Z)      • 

LO 

Q. 
X 

or  en 

cc 

1    1 

X   • 

:   i 

-tn 

S-Q 

1 

— — 1 1 1 < 

fO             Z'O             fO             Q- 

t-« 1 1 

0             l-Q-           20-         VQ 

-* 

I  3 

ycGS  lyayHi  'qni  Toy  /ou  "daa  Tad 

0) 

+J 

0) 

en 

c 

P    0) 

•H 

•r->  S-i 

c 

T!    0 

ftJ    U 

M^ 

U) 

0 

0) 

x;  -p 

•. 

(D 

-P    rrj 

-H 

N 

0) 

q; 

-H 

0  u 

13 

cn 

-P  £ 

0 

-P 

e 

en 

OJ 

c 

N   M 

Q 

•H 

•H 

s 

Q. 

CO  Eh 

PQ 

P 

< 

+ 

0 

CnU 

« 

>H 

C  CO 

0^ 

Cn 

•H   M 

— 

a.> 

(d 

p 

o 

0  13  o 

0) 

M   0) 

1 

en 

Cn-P 

D 

(d 

w 

< 

u 

w  p 

Eh 

P  -f-i 

Ul 

O  13 

«• 

■H 

rH      (T3 

rr 

x: 

P 

-p 

a  a; 

a 

0  x: 

Q) 

^ 

a-p 

u 

0 

fO 

P-, 

>il3 

^    C 

u 

<-{    to 

0 

• 

(d 

U-l 

, — , 

p  -- 

>i 

cr  (C 

_» 

en 

0)  -P 

(13 

QJ 

(13 

-p 

+J 

u-t  -^3 

(t3 

(d 

0 

13 

>H 

-p 

-p 

a,  c 

-P 

en  13 

•H    0) 

c 

OJ 

^  13 

(U 

M 

-p 

w  c 

13 

M 

o 

c;  0) 

C 

Q) 

0  a 

QJ 

CQ 

rH 

•H    0) 

ao 

(U 

-P  T5 

0) 

a 

cn 

(X3  — 

13 

CU 

-H 

c 

X 

en 

CD   O 

■H 

<c 

(d 

a  < 

^^^ 

^ 

5 

U3 

■T 

0) 

u 

p 

en 

t, 


194 


o 


o 

< 
< 

0) 


< 

Q 

h- 
Z 
LU 
Q 
Z 
LU 

a 

LU 

Q 

Z 


CD 

a 


LJ 
CD 


®  ;: 


s. 

lO 

o 

o 

o 

o 

o 

II 
M 

f 

(N 

U1 

Ul 

l/l 

(- 

>— 

►- 

< 

< 

< 

^ 

fO 

(0 

o 

^«- 

T- 

r- 

T— 

■■" 

lO 

d 

o 

o 

1— 

^ 

M 

(N 

ifi 

00 

o 

rt 

■^ 

0) 

00 

CO 

UJ 

00 

o 

o 

o 

n 

II 

^. 

M 

(N 

o 

in 

U) 

i/l 

< 

1- 

h- 

^ 

< 

< 

< 

«x 

# 

(0 

in 

O 

CO 

CD 

00 

00 

00 

00 

r>^ 

00 

o 

o 

O 

0) 

^■ 

„ 

CM 

n 

o 

^ 

(/) 

in 

in 

< 

< 

>- 

f- 

>- 

CO 
00 

r- 

5 

r- 

o 

r- 

isvoaaod 


< 


z 

UJ 
Q 

Z 

LU 
C 
LU 

o 


CD 

■^ 

r- 

r^ 
-^ 

CO 

in 

CO 

o 

oo 

O) 

CD 
CD 

J.SVD3«0d 


ct:  ~ 
o  % 

CJ   9 


CD 


s— 

z 

UJ 


en  —  ' 

~^  CO  Q- 

o  ^  °° 

1 — I  ID 

L-J  UJ  o 

LJ  ce  [-' 

Qi  01  ^ 

n  I  Q 


L_ 
O 

Ct: 

LJ 
CD 


o 
o 


- 

~ 

ce 

• 

(  1 

X 

n 

cc 

en 

i— 

T' 

o 

-L 

fil 

a: 

^ 

• 

• 

ri 

a. 

Q- 

Til 

■ 

■ 

tj 

UI 

1 

Q. 

a. 

d 

a 

Ill 

Ill 

>- 

z 

a 

a 

D 

• 

* 

• 

— r 
a'o 


— I — 


— I — 


— 1 — 
J'Q- 


r: 


g-Q         v'o         z'o         Q-o         j'Q-       *-a- 

i   LbOSiA  3^035  ly^yHi  ?  oy  a3isnray 


9-0- 


o 

o 

s 

1 

>i  e 

< 

U  -H 

Eh 

- 

D^  6  x: 

■^ 

C 

4J 

•H    0) 

m 

(T3 

-P  JZ 

•H 

(D 

C  -U 

LM 

Sh 

0 

fT3 

u  x: 

QJ 

Q 

-p  x: 

UJ 

Jh 

0)  -H 

4-) 

> 

0  x:  "2- 

K 

m 

&H 

+J 

UJ 

13 

(d 

in 

to 

(U 

tX3 
0 

+j 

•  -U 

13 

rH 

>i  fO 

0) 

p 

cn-H 

> 

CO 

(D    U 

q; 

(U 

4J   0 

•H 

M 

(T3  en  x: 

!-)   to 

CJ 

<D 

4-1    fO 

Id 

.-1 

to 

iD 

CO 

Q) 

(d 

M    0) 

M 

4-) 

i-l 

0 

CQ    0 

O 

>iO  o 

to 

u 

d:;  to 

c 

0. 

4J 

CD 

X    (D 

n3 

D^<    CO 

QJ 

C 

2    0 

U 

■H 

s:  x; 

+J 

CD  +J 

4J 

c 

x: 

0 

+J    0 

M 

u 

4J 

i-i 

H 

13 

0  to 

< 

C 

M-l  13 

u 

rd 

c: 

en    rH 

--  0 

M    <U 

e 

r-\  a>  > 

n3 

0)  to 

QJ 

S-i  T!    0) 

4-)  ^ 

CJi  0    S-i 

G 

fd 

e  sh 

Q)    >-l 

•H 

0 

13    0 

13 

Q    U 

C  -P 

s 

0)   o 

1— 1 

CQ    CU 

a-H 

iH 

+     rH 

0)  13 

•H 

a  XI 

13    CD 

^ 

Oi    Id 

C    V^ 

CO 

^  -p 

■H    Oi 

• 

to 

r<- 

^ 

<U 

^ 

3 

cn 

•H 

Ua 

195 


CM 
•«t 

O) 

CO 

I 

II 

o 

< 
< 

N. 
00 

CO 
N. 


o    9 
6    o 


r-        CO 


o 
d 


CD 

d 


# 

00 

CJ 

in 

in 

0) 

00 

00 

00 

in 

00 

o 

o 

o 

II 

" 

^ 

M 

o 

(/) 

I/) 

UI 

< 

1- 

K 

^ 

< 

< 

< 

< 

# 

CO 

^ 

CM 

K 

N. 

00 

in 

00 

00 

OU 

0) 

00 

1— 

d 

d 

O 

'' 

„ 

V- 

r* 

o 

^ 

t/1 

in 

(/i 

< 

< 

h- 

r- 

*- 

< 

G 

t- 
Z 
oi 
Q 

Z 


CO 

LJ 

ID 

a 


5 

126 

CN 
CO 

CO 
CO 

CO 

in 

^ 

in 

CM 

O) 

o 

O 

ctr 
m 


isvoaaod 


< 
< 


z 

o 

z 

c 

Ui 

a 


(0 
CM 

O 

a> 

O 

CO 
CO 

to 

O 

CO 

CN 
CO 

iswoauoj 


LJ   ° 

E— <    LJ 
M 

CD    0^ 

2     CD 

• — I    z 


en  ~ 


W) 

or  S 
o 

uJ    ce 


Q 


- 

•~ 

ce 

> 

o 

X 

n 

ce 

(E 

i- 

?» 

o 

X 

fii 

a; 

(— 

• 

• 

rn 

0- 

0- 

fi  1 

■ 

■ 

LJ 

LJ 

1 

n 

n 

(  1 

Q 

(•1 

(ii 

-<; 

^ 

o 

C-3 

a 

♦ 

X 

• 

— r 
80 


9'0  *Q  JO  Q-O  J'O-  ¥-0- 

[  ibQSiA  3^002  itiimi  ?  oy  Q^isnray 


o 

o      e 

1    >i  a 

:3  u  e 

<C   C  -H 

Eh    0)    X 

cn  (tj 

-  c  e  £ 

-^  -H 

4J 

+J    OJ 

l+H 

(C  c  x: 

•H 

(U   0  -P 

U-l 

M  o 

re       x: 

(D 

(U  +J 

x: 

V4  x:  -H 

4-1 

0   Eh    5 

4-1 

4J 

T3 

(T3 

cn    •  dj 

-p  >i-P 

HD 

-H   cn  (t3 

Q) 

P    0)  -H 

> 

cn  -u  u 

0) 

Q)  m  0 

■H 

M  M  cn 

x: 

+j  cn 

u 

OJ  cn  fd 

fT3 

i-i 

i2  M  cn 

0) 

ffl    M    0) 

^ 

-P         Sh 

0 

CQ  0 

0 

>iO  u 

cn 

o  cr;  cn 

C   D^ 

4J 

CD  X    (D 

(d 

Cn<C  cn 

(U 

C  S   0 

u 

•H      x: 

x: 

-p  dj  -p 

■p 

c  x: 

0  -P   0 

M 

U         -P 

u 

Eh 

T3   0  cn 

< 

C  4-1  T? 

U 

fC        c 

LO 

1— 1 

--  o 

M 

Q) 

e  M  a> 

> 

(T3  0)  cn 

0) 

>-i  T!    CU 

4J 

i-H 

cn  0    iH 

c 

t3    g    >-l 

<u 

V-l 

•H           0  Ti 

0 

T!  Q    O 

c 

4-1 

S 

(U 

o 

-H   PQ    QJ 

a 

•H 

iH    +  -H 

(U  t! 

•H  cc;  X!  -13 

QJ 

^  a-  ca 

c 

U 

CO  --  4-1 

•H 

a, 

X) 

r^ 

■<* 

OJ 

u 

3 

cn 

•H 

t. 

196 


to 
(d 

CM 

I 

II 

o 

< 

d 
CO 

o 

< 


00 
O 

CD 
O 

O 

6 

^ 

r< 

if) 

1/1 

K- 

»- 

< 

< 

o 

o 

h- 

(O 

T- 

r- 

<D 

o 

o 

O 


< 

Q 


Z 

LU 

o 

z 

a. 

UJ 
Q 

Z 


CO 

ZD 
O 


x:  en 

LJ    o 


CO 
CM 
CN 

o 

r^ 

If) 

If) 
in 

r>- 

CM 

00 

r- 

> 
a: 

UJ 

I/) 

CQ 

O 


i  SV03M  O J 


< 


Z 
liJ 

o 

z 

UJ 

c 

UJ 


o  ^ 


cn 
a; 
o 
f— 


Q 

a 


□ 


cr 

UJ 


O 

ct:: 

LJ 
CQ 


- 

— • 

ce 

• 

n 

X 

f— 1 

(I-- 

n 

H^  . 

t.1 

C_3 

X 

.4 

n 

o_ 

Q_ 

Ti  1 

■ 

■ 

LJ 

UJ 

tl 

n 

CI 

Q 

111 

111 

^ 

Z 

o 

a 

□ 

♦ 

X 

• 

^ 

CM 

00 

o 

T- 

N. 

00 

-* 

O 

o 

00 

II 

11 

^. 

M 

o 

LO 

1/1 

< 

h- 

h- 

< 

< 

< 

00 

in 

CM 
CM 

0) 

6 

CM 
00 

6 

'1 

II 

^ 

r< 

o 

^ 

10 

KfS 

< 

< 

(- 

y- 

00 

00 


o 


00 
CO 

to 

CM 

oo 

o 

ID 

in 

oo 

o 

O 

CO 

ID 

iSV33«Od 


— r 
>'0 


— r— 
J-Q- 


o 


CD 


9'0  9^0  >'0  Z'O  0"0  Z"Q-  >"0- 

[  lyosiA  3yoos  iti3Mni  ?  oy  OGisnrau 


9-[>- 


>1 

u 

c 

QJ 

D> 

G 

O  -H 

o  -p  e 

1     C   D 

D   0   g 

<C    U  -H 

E-«         X 

Q)    rtJ 

-x:  6  x: 

^   Eh 

+J 

(U 

m 

td      ji: 

■H 

0)      •  +J 

^+-1 

M  >i 

(C    XJ^SZ 

0) 

OJ    4J 

x: 

M    4-1  -H 

+j 

0    TJ    5 

M-l    S-l 

-p 

+J  'G 

(d 

cn  10  (u 

-p       -P 

T3 

.H     C     (T3 

OJ 

a    0  -H 

> 

W  -H    0 

QJ 

(U    U)    0 

•H 

M   w  cn 

x; 

0)  cn 

u 

QJ    M    td 

03 

rH   cn 

Xi   Q)   w 

(D 

td  V4  0) 

M 

-P         u 

0 

M    0 

U 

>i  rd    U 

tn 

U   M  cn 

C    P 

-p 

(U   +J    QJ 

(d 

cji  fd  cn 

QJ 

ceo 

u 

•H      x: 

r 

+j  a  +j 

•p 

c  x: 

O  -P   0 

M 

U         -P 

u 

Eh 

T!  0  cn 

< 

C  4-1  13 

u 

(d       c 

CO 

rH 

--  0 

M 

0) 

e  -H  a> 

> 

td  (U  cn 

(D 

V-i  T!    (D 

+J 

1— 1 

xs^  0  u 

c 

fO   g   s^ 

QJ 

M 

•H          0 

T3 

0 

Tl  Q    U 

C 

-P 

S 

(D 

u 

rH  m   QJ 

a 

•H 

nH    +   ,-H 

cu 

T3 

•H  cc;  12  TD 

0) 

^  04  (d 

c 

>H 

CO  —  -P 

•H 

Q4 

u 

r- 

"^ 

0) 

u 

p 

cn 

•H 

t^ 

197 


o 

< 

CO 
CO 

CM 

CO 
CO 

in 

C\J 

< 

CD 
Cvj 

CO 

00 

•** 

(0 

O 
< 

CO 

CO 

CD 
U5 

cvj 
1^ 

o 

< 

00 

CO 

0) 
CO 

CD 
CO     ' 

CJ> 

CO 
C35 

00 

o 

q 

6 

in 

CVJ 

r- 

CD 

00 
CO 

d 

0) 

d 

CO 
0) 

Q 
11. 

o 

0) 

o 
d 

CM 
CO 

6 

CO 
CM 
CO 

d 

o 

0) 
CO 

d 

o 

CM 
CM 

d 

o 
o 

•5 

0) 

w 

Q. 

Q 

m 

Q. 
Q 

Q 

Z 

Q. 

LU 
Q 

o 
o 
o 

T- 

QJ 

u 

c 

<D 

n 

•H 

IW 

c 

o 

u 

o\o 

LO 

O      " 

\^ 

o\o    0) 

UD  T3 

(Ti     0 

E 

T) 

C  Q 

(TJ  S 

CQ 

w  + 

u  ct: 

•H  a, 

-p  --- 

en 

-H  O 

+J  o 

nJ    1 

-M  ID 

tn  < 

^ 

M 

<   - 

\^ 

o 

<     (T3 

cu 

-  S-1 

QJ    TJ 

u 

^-^ 

c  u 

>. 

Q)    0 

en 

t3  ^ 

<D 

c 

■p 

0)  en 

(t3 

a  0) 

>-^ 

0)    D 

-p 

T!  -1 

en 

ta 

-H     > 

M 

(ti 

M 

C  M 

0    fl 

CQ 

■H     > 

o 

+J   u 

« 

O    (U 

cu 

C  +-' 

X 

Cl4    -H 

s 

00 

■^ 

0) 

)-l 

p 

en 

•H 

t. 

198 


\ 

• 

o 

■'T' 

\ 

i 

-Ol 

cr 

1 

' 

[J 

1                 ,' 

cr 

\                 ;' 

>—i 

, , 

1                                  » 

Ul 

1 

i-a: 

\             t 

-CD 

C3 

•^ 

cr  o 

Z 

CM 

3 

— <  > 

\         ; 

LJ 

CL 

cn 

>• 

\                 ( 

M 

n 

E- 

UJ 

\                » 

o 

o  ct: 

\                * 

CO 

rv 

1 

cc  o 

\                ', 

C3 

LJ 

f—  Ul 

\       ^ 

C£) 

L_ 

2: 

ZLJE— 

y       * 

CU 

O 

X 

\ 

3 
o 

o 

_jCl_  X 

\  \ 

•— • 

Q 

\      J 

(— ' 

,__, 

\      ( 

CJ 

■— ' 

LJ  Z 

• 

-lO 

-J 

CD 

tn 

LJ 

O 

=3      • 

' 

tn 

Q_ 
X 

or 

— )  — ) 

cncE 
1    1 

X   • 

\i 

-in 

s-o 

r        ■   -r- 

>-0           £-0 

1 

1      1 

to          00 

r 
fO- 

1 

20-        £0 

-" 

I    3^005 

lya^Hl   -QNI    TQU  /ou 

•d3a 

TQy 

Tl 

-d 

0) 

0) 

-U 

-p 

tn 

M 

u 

P    (U 

M 

QJ 

•f-1  5-1 

rH 

T3    0 

CQ 

QJ 

rd    U 

o 

tn 

tn 

cd 

0) 

0^ 

tn 

SZ  -P 

X 

03 

-P    (t3 

s 

5 

0   u 

QJ 

-p  x: 

^ 

> 

-p 

M 

•H 

OJ 

QJ 

M-l 

N    M 

t3 

•H 

0 

M-^ 

tn  Eh 

g 

0 

< 

CnU 

cc; 

QJ 

C  c/] 

cu 

N 

•H    M 

■ — ■ 

•H 

a> 

tfl 

p 

•^ 

0  T3 

(N 

D^ 

J-i    0) 

1 

C 

tTi-P 

D 

•H 

tn 

< 

a 

tn  0 

^ 

D 

0  -n 

0 

0  T) 

•. 

5-1 

rH      03 

•^ 

CT' 

J 

a  01 

03 

03 

0  sz 

QJ 

a-p 

u 

QJ 

03 

tn 

>.Ti 

03 

rH    c 

V-I 

u 

M    n3 

O 

ftJ 

M-l 

tn 

D  -- 

•H 

cr  fO 

^-^ 

x: 

OJ  -P 

03 

-p 

(C 

-P 

U-J  TJ 

03 

5-1 

0 

T3 

0 

-p 

fa 

a  c 

-P 

■H    QJ 

C 

£  T3 

QJ 

. 

tn  c 

n^ 

,— V 

C    0) 

C 

>1 

0  a  QJ 

cn 

•H    QJ 

a 

QJ 

^  T3 

QJ 

-P 

03  — 

T3 

03 

rH 

C 

S-i 

QJ  O 

■H 

-P 

«  < 

^''"*' 

tn 

• 

'^r 

QJ 

U 

3 

CP 

•H 

fa 

199 


< 

Q 


Z 
lU 

D 

Z 

ULI 
0. 

tu 
Q 

Z 


^ 

CO 

Tf 

CM 

o 

0) 

O 

o 

o 

O 

1 

o 

< 
< 

<D 

uj 

00 

t 

o 

4 


IT) 

q 

Cvj 


I- 
< 

in 
o 
d 


o 


O) 

o 


1/1 

< 

CO 

o 


^ 

CO 

CM 

o 

o 
d 

CO 

o 

1 

II 

^ 

f< 

o 

U1 

U1 

< 

t- 

p. 

< 

< 

n 

Jp 

f^ 

c» 

CO 

'<t 

0), 

CO 

o 

o 

U) 

CVJ 

o 

o 

^ 

^ 

(N 

o 

^ 

ifl 

l/l 

< 

< 

t- 

h- 

00 

o 


0> 

q 
d 


00 
CN 

CO 

o 

00 

in 

00 

'* 

CO 

OJ 

C>4 

CD 


a 


lS»03MOd 


< 

< 
Q 


Z 
lu 
O 
Z 
lU 

c. 
Q 


CN 
CO 

CM 

in 

CM 

CN 

00 
CM 
00 

00 

n 

CM 

o 

00 

00 

isvoaaoj 


T 

IT) 

O 

fj 

Q_ 

LJ 

O 

M 

f-i 

> 

LU 

in 

^ 

C3 

o 
in 

cc: 

CO 

o 

—) 

LJ 
CO 

o 

1 

t- 

en 

— 

^ 

> 

CO 

o 

Q- 
X 

tt: 

CE 

(-1 

rsi 

h- 

( 

LJ 

^r 

> 

Q 

o; 

en 

LJ 

ce 

1—1 

rr 

h- 

Q- 

t 

(_) 

L- 

a 

LJ 

o 

Q. 

Q^ 

LJ 

CD 

— 

•— 

o 

a: 

r~i 

cc 

OL 

H- 

7" 

CD 

X 

tl  1 

(E 

H^ 

• 

• 

f^ 

Q. 

U- 

* 

• 

UJ 

CJ 

1 

Q 

a. 

O 

c-j 

(lI 

I.} 

^ 

2 

LJ 

LJ 

^" 

'~' 

a 

• 

X 

• 

CD 

z 


0"t 


9"0  9'0  VQ  E'O  Q"0  2"Q-  ^'0- 

[  idosiA  3yo3s  ib3yni  ?  Ob  a3isnray 


CN    QJ 

1     .-1 

D  i3 

<    03 

H    4J 

-  >i  e  'n 

■^  o 

a 

u 

c 

e 

-H 

(T3    0) 

•H 

x; 

<u  cn 

X 

+j 

M    C 

fd 

r) 

fd  -H 

E 

(U 

■p 

x: 

Q 

u  c 

OJ 

-p 

UJ 

> 
nr 

0   0 

ji: 

U-l    0 

-p 

-p 

LU 

(13 

l/l 

W    Q) 

x: 

ffi 

^  -C 

-p 

T3 

o 

M  H 

•H 

Q) 

D 

5 

> 

cn 

0) 

0)     . 

T3 

■H 

5-1    >,  (U 

x: 

CP  -U 

u 

0)    OJ 

(d 

fd 

rH     -P 

•H 

X!    (T3 

o 

0) 

(d    >-i 

0 

u 

+J  +J 

w 

0 

W 

en 

o 

>i 

(T3 

en 

U    M 

c 

w 

-p 

0)  CQ 

(U 

fT3 

cnO 

u 

<U 

C   Oi 

0 

U 

•H    0. 

u  x; 

-P  X 

en 

+J 

c:  < 

> 

0  S 

(D 

M 

u 

en 

QJ 

0 

&H 

^  x:  s:  < 

C  -P 

4J 

u 

fd 

CO  -H 

5^ 

0 

M     (U 

e  0 

■p 

>     > 

(d  M-( 

(U 

^-1 

en 

-P    rH 

Cn^ 

T! 

C 

fd  -H 

c 

Q)    i-i 

•H    CU 

0  t:  0 

t3  T! 

a  c  -p 

0 

en 

(U    U 

-H  e 

(U 

Cu-H 

rH 

M 

(D  T3 

•H  cc; 

S-i 

T3    0) 

^   0. 

0 

C    S-t 

en  -- 

0 

■H  a, 

• 

(0 

o 

in 

(U 

M 

:3 

CP 

•H 

b 

200 


# 

(D 

U) 

CJ 

10 

(D 

o 

N 

o 

O 

1 

d 

O 

d 

ri 
(N 

^ 

<N 

o 

1/1 

10 

(/) 

< 

►- 

^— 

►- 

< 

< 

< 

< 

o 

o 

t>^ 

to 

T- 

6 

00 

CO 

o 

o 

M 

d 

M 

o 

«■ 

1/1 

in 

<n 

< 

< 

K 

>- 

»- 

# 

CM 
CO 

C\J 

in 

00 

00 

^ 

•* 

d 

o 

d 

II 

M 

<N 

o 

(/I 

(/) 

U1 

< 

t- 

1- 

^ 

< 

< 

< 

«l 

^ 

0) 

?fj 

(O 

-* 

00 

CO 

^  > 

in 

CO 

lO 

lO 

o 

0) 

h- 

o 

d 

<N 

" 

„ 

^. 

<N 

o 

^ 

in 

10 

1/1 

< 

Q 


Z 
lU 

o 

z 

UJ 

a 

lU 

Q 

Z 


CO 
LJ 

z: 
a 


CD  tn 

Z  CD 

1 — I  z 

CO  cfl 


>  g 

en  0- 

t-  1 

O 


UJ    ^ 
0-    , 

LiJ 
CD 


cj 

t^ 

00 

cs 

T— 

O 

in 

CO 

0) 
CN 

■^ 

in 

iSV03dOd 


< 

a 


z 
m 
Q 

Z 

UJ 

c 

LU 

o 


o 
co 

CM 

5 

CO 

0^ 

in 

CN 

CJ 

in 

h- 

in 

iSV33dOd 


-- 

o 

X 

r^ 

a: 

cr 

s- 

■;^ 

o 

j; 

Til 

(J. 

h- 

• 

• 

rn 

u_ 

a. 

• 

• 

I1.1 

LJ 

1 

n 

n 

(  1 

fi 

111 

111 

^ 

z 

a 

a 

^~' 

a 

♦ 

X 

• 

LO 

o 


u 

CD 

3 


O't 


8'0  9-0  >'□  2'0  O'O  Z"Q-  VO- 

[  idOSiA  3^035  Lyimi  1  oy  G3i9nray 


9-0- 


■^ 

CN 

e 

1 

D 

g 

< 

•H 

Eh 

X 

>^  n3 

•. 

u  e  x: 

T 

c 

-P 

0)    0) 

M-l 

n3 

cnx: 

•H 

QJ 

C  -P 

M-l 

S-i 

■H 

(0 

+J  x: 

QJ 

C  +J 

x; 

0 

UJ 

Sh 

0  -H 

4J 

0 

U    [5 

> 

14-J 

+j 

cr 

0)  T3 

fT3 

UJ 

en 

^    0) 

CO 

-P 

&H    +J 

TD 

CD 

iH 

(T3 

QJ 

0 

D 

•H 

> 

w 

•    0 

Q) 

0) 

>i  0 

•H 

u 

en  en 

x: 

(U  CO 

u 

OJ 

-p  en 

03 

rH 

03 

XI 

M   w 

Q) 

(d 

-P    OJ 

S-l 

■U 

tn  >-i 

0 

0 

0 

>,M    u 

en 

u 

M  en 

c 

+j 

0) 

CQ    Q) 

fd 

en  0  w 

QJ 

c 

fti   0 

u 

•H 

Oi  x; 

x: 

-P 

X  -P 

■p 

C 

< 

0 

2  0 

M 

u 

-p 

QJ 

tn 

'a 

jz  tn 

< 

c 

+J  TD 

u 

fO 

c 

CO    r-^ 

U   0 

M    QJ 

e 

0  a>  > 

fd 

M-i  in 

QJ 

M 

0) 

-P  -H 

CP 

^  M 

C 

(13 

M    S-l 

QJ    U 

■H 

QJ    0 

^    0 

TD 

T!    0 

C   -P 

0 

QJ    U 

iH 

6    QJ 

CIi-H 

rH 

rH 

Q)  T3 

•H 

Di  X!  T!    QJ 

^ 

CXi    fO 

C    M 

CO 

—  -P 

■H   a 

XI 

0 

in 

QJ 

U 

:3 

en 

•H 

t. 

201 


lO 

CVJ 

o 

T- 

CO 

o 

o 

o 

o 

o 

1 

o 

o 

1 

,, 

N 

p< 

^ 

<N 

o 

1/1 

1/) 

U1 

< 

►- 

h- 

h- 

< 

< 

< 

< 

# 

^ 

"* 

CO 

"t 

-* 

CJ 

^ 

CO 

o 

'". 

T- 

CD 

o 

o 

o 

co 

1— 

n 

^ 

^ 

(S 

o 

^ 

\A 

1/1 

I/) 

< 

< 

>- 

K 

H- 

z 

UJ 

D 

Z 

UJ 

a 

LU 

Q 

Z 


CO 
ZD 

a 


o 


C£i 


O 
O 
CO 


cn 


CO 

o 
o 


a 

a; 

fi  1 

CE 

ce 

cc 

Q_ 

1 

•<r 

\^ 

oo 

o 

or 

LJ 


^ 

CO 

o 

in 

CO 

CO 

ir> 

CO 

00 
CO 

O 

o 

6 

a 

M 

" 

^ 

M 

o 

ifl 

1/1 

in 

< 

>- 

h- 

^. 

<( 

< 

< 

«j 

^ 

"* 

«^ 

h- 

CM 

ID 

U) 

(0 

CO 

-* 

^ 

o 

0) 

d 

o 

O 

O 

(N 

<N 

o 

^ 

wi 

10 

tfl 

< 

< 

1- 

f— 

1- 

o 
in 

0) 

0^ 

CM 

o 

(D 

GO 
CM 

CO 

OJ 

ii:  Q 


;^   03 


isvoaaod 


< 

Q 


Z 
Ui 

O 

z 

UJ 

c. 

UJ 


CO 
CO 

to 
in 

o 

T- 

0) 

o 

o 

CM 

o 

00 

i.SV03dOJ 


„ 

— • 

o 

11: 

o 

ct 

0. 

f- 

■;^ 

o 

X 

fll 

a: 

h- 

• 

• 

rn 

11. 

0- 

fi  1 

• 

• 

CJ 

LJ 

I 

n 

n 

1  1 

Q 

til 

ii  1 

^ 

JL 

LJ 

C_) 

•"• 

a 

• 

X 

• 

O'l 


80  9-0  ^•Q  20  Q-0  Z'O-  »•()- 

[  lyQSiA  3yoos  lyj^Hi  ?  ou  a3isnray 


9-0- 


>1 

o 

"^    c 

(N    (U    E 

1    cn  D 

O   C    E 

<   -H  -H 

E-"  -P    X 

c  (d 

-  0  g  ji: 

•^  u 

+J 

0) 

U-I 

(T3  0)  x: 

•H 

(D  x;  -p 

14-1 

v^  H 

(0      j: 

<u 

-p 

x: 

S-l      .  -H 

-p 

0    >i  3 

M-i  cn 

+j 

0)  T3 

(d 

W  4J    (U 

-P    (T3  +J 

T3 

rH    S-i    nj 

O 

P  -P  -H 

> 

w  w  u 

0) 

0)         0 

■H 

5-1  c  cn 

^ 

0  w 

o 

(U  -H    to 

(d 

.H    W 

JD    W    0) 

a; 

fd  a;  a) 

>-i 

-P    S-i    >-i 

0 

cn  0 

o 

>i  (D    U 

CO 

U    S-l    CO 

c 

-p 

0)    rH      0) 

(d 

cn  (d   cn 

0) 

C    S-i    0 

^ 

•H  D  x: 

x: 

+J    -P    4J 

-p 

c  fd 

0    C    0 

M 

U         -P 

(D 

Eh 

TD  x:  CO 

< 

C  -P  T3 

u 

td       c 

cn 

M 

^^    0 

M 

<D 

e  0  a> 

> 

fd  u-i  CO 

QJ 

U          0 

-P 

nH 

cn—  U 

c 

(d  M  ^ 

<D 

M 

•H    0)    0  TD 

0 

^  X3    0 

C 

-P 

0 

0) 

0 

-H    g   0) 

a 

•H 

■H          iH 

QJ 

TD 

•H  Cli  i3  XI 

0) 

,i»:i  a.  (d 

c 

M 

W  —  +J 

•H 

a 

• 

o 

u-i 

(U 

M 

p 

cn 

•H 

fc 

202 


o 
< 

CO 

00 
CO 

in 
in 

CO 

in 

O) 
CVJ 

csr 

< 

to 

in 

T- 

cvi 

CVJ 

CD 

in 

CD 

CO 
0) 

o 
< 

CO 

CD 
CO 

in 

CO 

CO 

CO 

CO 
CO 

in 

o 
< 

CO 

q 
in 

CO 

CVJ 

in 

CO 

CO 

CD* 
00 

in 

0) 

Q 
a. 

O 
O 
CO 

CD 

CO 
CVJ 
CVJ 
CVJ 

6 

CO 

CVJ 
CD 

CO 
CJ) 

Tt 

CO 

d 

CD 

cn 

Q 
U- 

CVJ 

d 

CD 
CVi 

in 

CD 

cvi 
6 

00 
CVJ 

CD 

o 
in 

CO 

d 

O 
o 

<u 

w 

Q. 

ID 
CM 

en 

h- 
> 

Q. 
Q 

1- 
Q 

cc 

H- 
Z 
LU 

o 
in 

00 

> 

Q 

t- 

> 

o\o 

in 

O   CC 

\  cu 

o\o  — ' 

v^ 

<T\  -^ 

CsJ 

^     1 

C   D 

fd  < 

E-i 

w 

u    - 

•H  "^ 

4-1 

m  03 

•H    0) 

-p  i-i 

fa  fd 

+j 

CO    u 

0 

.—1   U-l 

<C 

.-^ 

\  en 

>^ 

o  0) 

XJ^ 

<  P 

(D 

1— 1 

-P 

-  fd 

(d 

dj  > 

u 

u 

-P 

C    rH 

tn 

Qj  (d 

t:  > 

M 

C    S-i 

M 

(U    (U 

a-K 

CQ 

(U   c 

O 

TD  -H 

cr; 

ex 

rH      0) 

X 

(d  u 

s 

0    OJ 

■H    rO 

- 

+J  -H 

rH 

U  4-1 

o 

c  c 

T3 

P   0 

0 

bn     U 

e 

in 
<u 

en 

•H 
fa 


203 


\ 

* 

- 

_o 

■fl^ 

\ 

\    ^ 

-0) 

cr 

\     \ 

UJ 

\      \ 

ct: 
<x. 

\ 

_ 

Ol 

1 

h-o: 

if      y 

-co 

C3 

■^ 

cc  CJ 

■z. 

CM 

CJ  en 
(n  — 

— •  > 

\ 

LJ 

Q- 

cc 

> 

\     1 

M 

ID 

E— 

txj 

\    ' 

o 

OCT 

I    I 

cn 

1 

(TO 

\   , 

O 

C3 

i—  CO 

i    4 

-[^  Z 

LJ 

qz 

L_ 

2= 

2  LJS— 

\      1 

qT 

a 

QJ 

Scaor 

\     ', 

o 

-z. 

CJ 

LJCJCC 

\     ' 

o 

CO 

CiJh^ 

\     'i 

•— < 

a 

\     1 

t-H 

, J 

caca 

X    • 

-<D 

cuz 

_J 

CD 

en 

LlJ 

O 

3    • 

CD 

cc: 

Q_ 
X 

cc  cc 

(X 

1    1 

z: 

X    • 

-Ul 

1 — 

1    ■-  — 

■  T    ---          I 
10             00 

1 
ro- 

Z'O-         fO 

I  3yoos 

lyayHi  -qni  TOb  /oy 

•d3a 

TQB 

(1) 
-P 

D 
•r~i 
T3 

QJ 

+-1 

o 
+J 

0) 
N 
•H 
CO 


< 


o 

e 

Q 

s 

+ 

C    W    Oh 
■H    M  --^ 

O  ^3  CN 

S-)    QJ  I 

Cn-U  3 

en  < 

CD   3  Eh 

O  T3     - 

P 

o  x:  oj 


0) 


0 
N 


rH     (T3 

XT  03 
03 

o 
-p 

a  c 

•H     (1) 


en 
c 

•H 

a 

D 
O 
S-l 

en 
tn 

03 

u 

•H 

x: 
-P 

u 
o 


V) 

c 
o 

•H 

-p 

03 

rH 

QJ 
0^ 


05 
-P 
03 

-P 
C 
CU 
C  T) 
0)    C 

a  0) 
(D  a, 

c 

O  -H 

<  — 


>1 

en 
<u 
+J 

03 

-p 

tfi  73 

(U 

M    +J 

M     O 

QJ 

CQ   rH 

O    Q) 
Cd    CO 

a, 

X    CO 

<    03 

2   ^ 


fN 
Lf) 

(U 
M 

D 
Cn 

■H 
Cm 


204 


in 

CVJ 

lO 

co 

o 

0) 

o 

o 

6 
1 

r- 
1 

o 

o 

(N 

r- 

(N 

O 

1/1 

(/I 

l/l 

< 

h- 

K- 

>- 

< 

4 

< 

< 

CO 
0) 

o 

"^ 

CO 

■ 

'«t 

o 

o 

d 

o 

^ 

in 

iA 

t/1 

< 

< 

K 

*— 

t— 

7fi 
CM 
"*, 
CO* 
CO 
II 

o 

< 

CO 
CVJ 

CO* 


CO 

in 

00 

o 

o 

CO 

CO 


^ 

0) 

rs. 

CO 

CO 

m 

CO 

o 

6 

00 

CO 
d 


< 


2 
lU 
O 

z 

LU 
Q. 
UJ 
Q 

Z 


CO 
LJ 


UJ    o 


? 

r^ 

^ 

CO 
CO 

CO 

to 

CO 

^ 

'^ 

iSVD3aOJ 


< 


z 

UJ 

o 

z 

UJ 

c. 

UJ 

n 


00 
CM 

CN 

O 

5- 

CO 

O 

•^ 

in 

CM 

r)  <N  - 

isvoaaoj 


CD 


cs 


o 

o 


CO    g 


en  --  - 

■^-.     CD  O 

-^     O  CD 

q:  o 

00    ??  M 

I — '  Csl 

8—1      I  Q 

C-J     TT  CD 

f— I     X  CO 

fi  1    eg  O 

^    '  5 

•"f  OJ 

O    g  "^ 
f— 

q:: 

LJ 
DO 


V. 

• 
1 

f 

f 

- 

^ 

>            X 

\       ,' 

\    / 

-tn 

^ 

^ 

-ry 

ce 

•    O    X 

a         cc  X  f- 

z    O    X 

ili  X  f-     •     • 

CD                    Q-    Q- 

LJ       •       •    LJ    UJ 

_]    Cl_    Q.    C3    a 

LJ    UJ    Z    Z 

1=1    O    — '    " 

F 

IM 

1 

; 

-- 

a    *    X    • 

1              I 

1                            I 

f          1          1 

(-a 

en 
Cd 
O 


o-i 


8'0  3-0  ♦•O  20  O'O  Z^O-  ►■D- 

[  LBGSiA  3yoG9  L^inui  1  oy  a3i9nrQy 


9-D- 


'^ 

CN 

1 

^    >i 

<    0 

H    C 

(U 

CU 

x: 

-  a^ 

4J 

^  c 

•H    <U 

4J 

fd  4-)  ^ 

03 

OJ  c  -u 

M   0 

TJ 

fo  0  x: 

CJ 

4-1 

> 

M    (U  -H 

0) 

0  x:  5 

■H 

M-l  E-t 

x: 

■n 

u 

U)           0) 

fCi 

-p    .  +J 

-H     >i  (T3 

Q) 

D   Cn-H 

U 

w  tu  U 

0 

0)  -P    0 

u 

M    fO    U) 

en 

>-i   en 

dj  4-)  (d 

4J 

M  en 

(13 

X)        en 

Q) 

rC  M    (D 

U 

-P         MX! 

pa  0 

4-1 

>ig  y 

u  cc;  en 

H 

C  0^ 

QJ  X    (U 

E-" 

ai<;  en 

< 

C  S    0 

U 

■H      x: 

CO 

4J    (U   4J 

H 

c  x: 

>  ^ 

0  -P    0 

0) 

U           4J 

-p  > 

u 

C    Q) 

T!  0  en 

Q)    r-\ 

c  144  -r! 

^ 

03        c 

C    5-4 

—  0 

d)    0 

e  -^  a 

a4J 

fO  0)   en 

<D   u 

M  TD    0) 

T!  -H 

tn   0     V4 

c:  T3 

fd  e  5^ 

•H    Q) 

•H           0 

S-l 

'a  Q  u 

e  a 

X 

:3 

^  OQ    0) 

6  x: 

iH    +   iH 

■H    4-1 

■H  a;  X3 

X  4-1 

^   0^    tT3 

fT3  -H 

CO  -^  4J 

g   "W 

(i 

m 

in 

(U 

u 

0 

o^ 

■H 

fe 

205 


^ 


0) 

CO 

CO 

o 

0) 

o 

o 

o 

CO 

1 

d 

o 

1 

^ 

a 

o 

1/1 

l/l 

Ul 

< 

H 

►- 

^* 

< 

< 

< 

4 

^ 

J^ 

r- 

CO 

CJ) 

"* 

"* 

N. 

""t 

o 

T- 

0) 

r- 

o 

o 

o 

s. 

1 

<N 

„ 

M 

o 

^ 

l/> 

1/1 

lA 

< 

< 

►- 

^ 

h- 

7fi 

CM 

o 

r^ 

-* 

0) 

CO 

00 

o 

o 

00 

^- 

c^ 

o 

(/1 

(/I 

< 

1- 

^- 

< 

< 

< 

# 

CO 

w? 

o 

CO 

CM 

CO 

O) 

CO 

00 
0) 

CD 

o 

o 

p( 

o 

< 

< 

1/1 

10 

00 

6 


0> 
00 


Z 

UJ 
Q 

Z 

UJ 

a. 

lU 
Q 

Z 


CD 
LJ 


a 


CJ 
LJ 


CM 

CO 

CM 

oi 

00 

- 

oi 

- 

(O 

isvoauoj 


< 


a 

z 

a 


CM 

5 

-^ 

CM 

CM 
(O 
00 

■^ 

O 

- 

o 

00 

isvoaaoj 


CD    01 


o 

CJ 


cn  ~ 


en 

o 

Q- 

o 

- 

O 

■"■ 

O 

on 

X 

H- 

Q 

n 

q; 

CT 

e- 

o 

TT 

IT 

LJ 

rn 

J. 

CL 

Q- 

Q 

IT 

in 

LJ 

1 

n. 

Q- 

LJ 

LJ 

a 

LJ 

a: 

o 
o 

LJ 

o 

LJ 

Q 

-£ 

z 

0 

1 

' 

a 

n 

• 

t 

• 

L_ 
O 

cc: 

LJ 
CD 


en 
o 


80  9"0  V'O  2"0  0"0  Z'Q-  >"CI- 

[  Idas  I A  3yoos  iy3yHi  ?  ou  aaisnray 


3-D- 


■^ 

1 

>i 

D 

U 

< 

c 

tH 

(U 

CD 

en 

x: 

- 

C 

+J 

•«5" 

■H 

+J    0) 

4-J 

03 

c  r 

(13 

0) 

0  -P 

5-1 

0 

T3 

to 

£ 

0) 

n 

CU  -P 

> 

Q 

^-1 

x:  -H 

0) 

UJ 

0 

Eh  ;s 

■H 

> 

M-l 

x: 

0,0= 

T3 

u 

UJ 

W 

•    CU 

(0 

1/1 

-P 

>1-p 

ffi 

(— ( 

cji  fd 

<u 

o 

D 

(U  -H 

Sh 

^" 

W 

-P   u 

0 

OJ 

(13    0 

u 

u 

■P    w 

en 

0) 

W    (13 

+J 

i-H 

(0 

XI 

H  en 

a 

(0 

H    OJ 

>-l 

-p 

S-J 

x: 

m  0 

-p 

« 

>iO  u 

u 

a  w 

M 

c 

04 

(U 

X    (D 

Eh 

en  <C  en 

< 

c 

2   0 

u 

•H 

x; 

(XI 

-P 

0)  +J 

M 

c 

j: 

>   -I 

0 

-P   0 

OJ 

u 

-p 

-p  > 

u 

c  q; 

^ 

0  w 

OJ  .H 

c 

4-<  T3  TD 

1T3 

c 

C    V^ 

--  0 

CD    0 

E 

rH  a 

a-P 

fO 

OJ  en 

CU   u 

S-i 

T3    QJ 

T3  -H 

CJ^ 

0    S-i 

C  TJ 

ffl 

E  s^ 

•H    (U 

•H 

0 

S-I 

TD 

Q    U 

a  cu 

s 

D 

rH 

CQ    0) 

E  r 

rH 

+  -H 

•H    +J 

•H 

«  X! 

X    <+-! 

^ 

CU    (T3 

03  -H 

w 

—  -P 

E  'w 

* 

i2 

m 

lo 

(U 

5^ 

D 

CTi 

206 


^ 

lO 

o 

CO 

""t 

o 
q 

6 

o 

o 

CO 

1 

d 

o 

o 

<N 

II 

^ 

<N 

*- 

o 

4/1 

un 

;rt 

< 

t- 

h- 

t~ 

< 

'■i 

< 

< 

^ 

-* 

SP 

CO 

in 

lO 

'". 

00 

o 

'". 

d 

r- 

€0 

• 

CO 

o 

o 

c< 

O 

^ 

10 

\A 

U1 

< 

< 

h- 

*~ 

# 

CO 

O) 

CO 

u> 

in 

00 

00 

tu 

h- 

o 

o 

o 

00 

'1 

A 

r- 

M 

o 

Cfl 

to 

U1 

< 

h- 

h- 

f— 

< 

< 

< 

< 

0) 

^ 

O) 

in 

00 
00 

o 

00 

CO 

00 

0> 

d 

o 

d 

9 

■^ 

<N 

(N 

o 

^ 

ui 

lA 

Ul 

< 

< 

>- 

1- 

t- 

< 


z 

D 

Z 

UJ 

a 

lU 
Q 

Z 


a 


LJ 


CD 


o 
o 
en 


en  K 


CO 

cc 

CD 
f— 
CJ 

I — I 

a 

LJ 
L_ 

o 

UJ 
CD 


T- 

CN 

o 

o 

in 

CN 

in 

in 

o 

CN 

in 

CO 

iSV03«Od 


< 
Q 


Z 
UJ 

O 

z 

ui 
c 

UJ 

O 


CO 
CO 

CM 

(O 

O 

5 

CN 
CO 

o 

o 

Ci 

CN 

isvoaaoj 


~ 

— ' 

n 

n 

(i: 

li. 

h- 

7' 

O 

X 

r,i 

0- 

H- 

• 

• 

rn 

CL 

Q- 

fil 

• 

t 

LJ 

LJ 

1 

a. 

Q 

f  1 

CM 

Ill 

111 

y 

Z 

LJ 

CJ 

'~* 

•"• 

a 

* 

X 

• 

CD 

r: 

2 


a^O  9'0  VO  2-0  O'O  fO-  i'O- 

[  lyosiA  3^005  L^imi  ?  OB  anisnrau 


9-0- 


■^ 

CM 

1 

D             T) 

<               OJ 

H               > 

0)  xi  (U 

-^  a;  -H 

^   t^   4J  ^ 

d   o 

fO         -H    (li 

0)     •  u 

M    >,  0    (U 

(d  iT>  en  M 

(U    W    0 

Q 

S^  -U    fO    u 

UJ 

0     fT3            W 

> 

U-l    >-|    w 

cr 

4J    QJ    4-) 

UJ 

if)  m  u  ^ 

LO 
CQ 

O 

4-1         0   QJ 

M    C    U    M 

:3  0  en  r; 

0)  -H          4-1 

dj  en  OJ 

V4  en  tn  M 

(D    0 

0)    U  x:   ir* 

rH    Cr>4-1   < 

XI    (D         U 

03    J-l    0   CO 

4J          4J   M 

rH            > 

>i  (li  cn 

U    S-i  Id   4-1  -H 

C    D    C    G    Q) 

CU   4J    0    0)    > 

D^  (d    CLtJ    0) 

C    C    LO    C  -H 

■H          (U    CD 

4J  (u  j-i  a  >-i 

c  x:  !-i  0)  0 

0    4-10^4-1 

u       u  c  u 

>-l          -H  -H 

Ti    0    CU        'O 

C    U-J    rH     g     Q) 

fd       Xi   0  u 

--  d  g  a 

e  rH   4J  -H 

fd  Qj       X  x: 

M  T!    >,  fd   4-) 

cp  0  u  e  ^ 

fd  e  c;      -H 

■H          OJ    0)  ^ 

T)  Q    Cnx; 

S    C   4J    OJ 

rH    CQ  -H          J^ 

rH  +  4J  x:  -p 

•H  a  c  4J 

^i    CU    0  -H   +J 

en  —  u  5  fd 

u 

ro 

in 

0) 

j-i 

a 

Cr> 

-H 

t. 

207 


o 

r- 
< 

CO 
CO 

CD 
CO 

in 

CVJ 

< 

in 

cvi 

csi 

T- 

(0 

CO 

CO 
0> 

*-» 

o 

< 

CO 

00 

CO 

in 

CO 
CvJ 

o 

< 

2P 
CO 

CO 

CO 

CO 

CD 
CO 

CVJ 
0) 

CNJ 
06 

0> 

Q 

CO 
CO 
CO 

0 
c> 

6 

CO 

in 
6 

in 
0 

CJ 

a 

CO 
0) 

>»» 

Q 

li. 

0) 
CJ> 
CO 

0 

6 

in 
in 

6 

00 

Oi 

T- 

0 

T— 

CVJ 

6 

o 
o 
■5 

Q. 

C\J 
Q 

m 

0 
0 
0 

IT- 

LU 

Q. 
Q 

3 
Q 

in 

CVJ 
0) 

> 

Q 

OJ 

u 

c 

q; 

TD 

•H 

M-l 

C 

0 

0 

o\o 

lD 

0      ^ 

^-H 

o\o    QJ 

^  XJ 

(T\    0 

e 

TD 

C    Q 

03  S 

CQ 

en  + 

U  0^ 

■H   &, 

-u  — 

en 

•H  vr 

-p  CN 

fT3     1 

4J  :d 

en  < 

H 

r-l 

<        - 

\^ 

0 

<    (K 

Q) 

-  S^ 

0)  fd 

0 

^-^ 

C    i-i 

>i 

0)   0 

tji 

T^  M-l 

0) 

C 

4-1 

(1)  cn 

03 

a  0) 

U 

0)    D 

4-1 

TD  -H 

cn 

■TJ 

-H    > 

M 

03 

M 

C  -H 

0  fd 

CQ 

•H    > 

0 

4-1    U 

Di 

U    Q) 

O, 

C  -P 

X 

H^    C 

< 

Cl,  -H 

s 

■^ 

LO 

QJ 

V-i 

a 

!T> 

■H 

|i( 

208 


DEPENDENT     DATA 


< 
O 


65 

299 

2386 

5 

37 

71 

11 

32 

32 

1  2  3 

OBSERVED 


INDEPENDENT     DATA 


31 

145 

1207 

2 

16 

34 

5 

14 

15 

A0^82.85%  AAo  =  -12.25% 

Ai.13.85% 

Tsi=0.08       ATsi=0.05 

TS2=0.08         ATS2  =  -0.05 
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Figure    55. 


Contingency  table  results  for  the  area  4, 
TAU-24  equal  variance  threshold  model 
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Figure    62. 


Contingency  table  results  for  the  area  4, 
TAU-48  equal  variance  threshold  model 
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Figure  63.   Contingency  table  results  for  the  area  4, 
TAU-48  quadratic  threshold  model 
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Figure  68.   Contingency  table  results  for  the  minimum 
probable  error  threshold  model  (EVAR)  for 
area  4,  TAU-24.   The  contingency  tables  reflect 
VISCAT  I+II  versus  VISCAT  III  and  VISCAT  I 
versus  VISCAT  II  separations 
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Figure  69.   Contingency  table  results  for  the  maximum- 
likelihood-  of  -  detection  threshold  model  for 
area  4,  TAU-24.   The  contingency  tables 
reflect  VISCAT  H-II  versus  VISCAT  III  and 
VISCAT  I  versus  VISCAT  II  separations 
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